[ 529.724511] env[65355]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 529.724511] env[65355]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 530.722267] env[65446]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 530.722267] env[65446]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 532.548225] env[65446]: INFO neutron.common.config [-] Logging enabled! [ 532.548673] env[65446]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev79 [ 532.548722] env[65446]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65446) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 532.548985] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 532.549089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 532.549881] env[65446]: WARNING oslo_policy.policy [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.550103] env[65446]: WARNING oslo_policy.policy [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.551723] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] VMware NSXv3 Agent initialized successfully. [ 532.552085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] Acquiring lock "singleton_lock" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.552237] env[65446]: DEBUG oslo_concurrency.lockutils [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] Acquired lock "singleton_lock" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.552465] env[65446]: DEBUG oslo_concurrency.lockutils [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] Releasing lock "singleton_lock" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.552744] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] Full set of CONF: {{(pid=65446) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 532.552856] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ******************************************************************************** {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 532.552976] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] Configuration options gathered from: {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 532.553574] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 532.553751] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 532.553861] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ================================================================================ {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 532.554041] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] agent_down_time = 75 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.554182] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] allow_automatic_dhcp_failover = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.554315] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] allow_bulk = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.554457] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] api_extensions_path = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.554648] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] api_paste_config = api-paste.ini {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.554812] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] auth_strategy = keystone {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.554919] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] backdoor_port = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555032] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] backdoor_socket = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555172] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] backlog = 4096 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555309] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555462] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] bind_host = 0.0.0.0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555602] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] bind_port = 9696 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555732] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] client_socket_timeout = 900 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555865] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] config_dir = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.555974] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.556129] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] config_source = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.556305] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] control_exchange = neutron {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.556383] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] core_plugin = ml2 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.556518] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] debug = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.556649] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] default_availability_zones = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.556849] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.556985] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] dhcp_agent_notification = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.557128] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] dhcp_agents_per_network = 1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.557256] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] dhcp_lease_duration = 86400 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.557393] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] dhcp_load_type = networks {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.557527] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] dns_domain = openstacklocal {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.557688] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.557823] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] enable_default_route_bfd = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.557953] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] enable_default_route_ecmp = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.558096] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] enable_dvr = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.558227] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] enable_new_agents = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.558356] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.558484] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] enable_signals = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.558612] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] enable_traditional_dhcp = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.558738] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] external_dns_driver = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.558868] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] filter_validation = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.559016] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] global_physnet_mtu = 8950 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.559154] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] graceful_shutdown_timeout = 60 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.559330] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] host = cpu-1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.559469] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] host_dvr_for_dhcp = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.559600] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] http_retries = 3 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.559734] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] instance_format = [instance: %(uuid)s] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.559866] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560034] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ipam_driver = internal {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560143] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ipv6_pd_enabled = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560271] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] l3_ha = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560405] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560543] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] l3_ha_network_physical_name = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560710] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] l3_ha_network_type = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560854] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_color = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.560991] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_config_append = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.561146] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.561279] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_dir = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.561410] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_file = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.561513] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_options = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.561647] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_rotate_interval = 1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.561785] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_rotate_interval_type = days {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.561920] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] log_rotation_type = none {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562061] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562140] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562310] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562456] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562560] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562693] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] max_dns_nameservers = 5 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562820] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] max_header_line = 16384 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.562977] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] max_l3_agents_per_router = 3 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.563112] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] max_logfile_count = 30 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.563244] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] max_logfile_size_mb = 200 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.563371] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] max_subnet_host_routes = 20 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.563504] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] my_ip = 10.180.1.21 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.563656] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] my_ipv6 = ::1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.563792] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] network_auto_schedule = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.563920] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] network_link_prefix = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.564079] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.564221] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] notify_nova_on_port_data_changes = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.564358] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] notify_nova_on_port_status_changes = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.564493] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] pagination_max_limit = -1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.564621] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] publish_errors = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.564749] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] rate_limit_burst = 0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.564886] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] rate_limit_except_level = CRITICAL {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565026] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] rate_limit_interval = 0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565160] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] retry_until_window = 30 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565289] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] router_distributed = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565416] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] rpc_resources_processing_step = 20 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565544] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] rpc_response_max_timeout = 600 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565675] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] rpc_response_timeout = 60 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565802] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] send_events_interval = 2 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.565947] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] service_plugins = ['router'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.566098] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] setproctitle = on {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.566225] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] shell_completion = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.566407] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] state_path = /opt/stack/data/neutron {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.566486] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] syslog_log_facility = LOG_USER {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.566636] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] tcp_keepidle = 600 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.566782] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] transport_url = **** {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.566911] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] use_journal = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567047] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] use_json = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567178] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] use_ssl = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567302] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] use_stderr = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567434] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] use_syslog = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567562] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] vlan_qinq = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567686] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] vlan_transparent = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567813] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] watch_log_file = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.567944] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] wsgi_default_pool_size = 100 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.568084] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] wsgi_keep_alive = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.568223] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.568355] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] wsgi_server_debug = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.568501] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_concurrency.disable_process_locking = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.568644] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.568784] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.568917] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.569068] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.569211] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.569347] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.569495] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.connection_string = messaging:// {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.569653] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.enabled = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.569820] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.es_doc_type = notification {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.569961] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.es_scroll_size = 10000 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.570114] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.es_scroll_time = 2m {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.570248] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.filter_error_trace = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.570387] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.hmac_keys = **** {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.570526] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.sentinel_service_name = mymaster {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.570666] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.socket_timeout = 0.1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.570799] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.trace_requests = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.570932] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler.trace_sqlalchemy = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.571091] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler_jaeger.process_tags = {} {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.571229] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler_jaeger.service_name_prefix = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.571364] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] profiler_otlp.service_name_prefix = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.571513] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.enforce_new_defaults = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.571767] env[65446]: WARNING oslo_config.cfg [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 532.571917] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.enforce_scope = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.572074] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.policy_default_rule = default {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.572226] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.572368] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.572509] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.572668] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.572816] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.572980] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.573121] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.573265] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.573414] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.573585] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] agent.extensions = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.573732] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.573873] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] service_providers.service_provider = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.574030] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.default_quota = -1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.574206] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.574346] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_floatingip = 50 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.574482] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_network = 100 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.574614] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_port = 500 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.574745] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.574875] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_router = 10 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575012] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_security_group = 10 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575151] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575289] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.quota_subnet = 100 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575423] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] QUOTAS.track_quota_usage = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575568] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575698] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep.group = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575827] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep.helper_command = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.575958] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep.log_daemon_traceback = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.576107] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.576240] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep.thread_pool_size = 8 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.576367] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep.user = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.576548] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.576627] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_dhcp_release.group = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.576752] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_dhcp_release.helper_command = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.576879] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577017] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577150] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577279] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_dhcp_release.user = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577417] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577543] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_ovs_vsctl.group = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577669] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577796] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.577928] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578067] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578200] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_ovs_vsctl.user = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578336] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_namespace.capabilities = [21] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578462] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_namespace.group = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578590] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_namespace.helper_command = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578718] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578852] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.578986] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.579130] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_namespace.user = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.579269] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_conntrack.capabilities = [12] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.579397] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_conntrack.group = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.579526] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_conntrack.helper_command = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.579659] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.579793] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.579924] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580062] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_conntrack.user = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580204] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_link.capabilities = [12, 21] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580334] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_link.group = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580458] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_link.helper_command = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580587] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_link.log_daemon_traceback = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580722] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580854] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_link.thread_pool_size = 8 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.580982] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] privsep_link.user = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.581169] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.581314] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.581449] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.continue_on_failed_promotions = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.581580] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.dscp = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.581714] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.dscp_inherit = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.581849] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.force_mp_to_policy = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.581981] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.locking_coordinator_url = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.582130] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.log_agent_heartbeats = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.582262] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.logging_expire = 1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.582401] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.582534] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.582671] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.polling_interval = 240 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.582804] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.582947] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.583119] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.report_interval = 30.0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.583267] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.583406] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.583542] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.583677] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.sync_skew = 60 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.583812] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.synchronization_queue_size = 20 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.583953] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT.use_helper_for_ns_read = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.584144] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] SECURITYGROUP.enable_ipset = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.584295] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] SECURITYGROUP.enable_security_group = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.584435] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.584574] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.584712] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] experimental.ipv6_pd_enabled = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.584884] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.extension_drivers = ['port_security'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.585113] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.external_network_type = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.585362] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.585596] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.overlay_ip_version = 4 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.585827] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.path_mtu = 8950 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.586077] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.physical_network_mtus = {} {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.586302] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.586459] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.586655] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ml2.type_drivers = ['vlan'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.586753] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.586886] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.587038] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.587192] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.587337] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.587477] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.587616] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.587759] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.587897] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.588109] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.588261] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_login_password = **** {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.588406] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.588545] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_login_user = admin {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.588682] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.588821] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.588954] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.589103] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.589244] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.589387] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.589527] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.589664] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.589797] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.589934] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.590087] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.590222] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.590359] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.590547] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.590689] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.590827] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.590960] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.591115] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.auth_section = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.591260] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.auth_type = password {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.591399] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.591568] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.certfile = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.591758] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.collect_timing = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.591914] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.endpoint_type = public {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.592063] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.insecure = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.592191] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.keyfile = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.592334] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.region_name = RegionOne {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.592471] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.split_loggers = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.592601] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] nova.timeout = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.592739] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.auth_section = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.592883] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.auth_type = password {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.593056] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.593198] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.certfile = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.593334] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.collect_timing = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.593473] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.endpoint_type = public {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.593606] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.insecure = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.593734] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.keyfile = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.593861] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.region_name = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594021] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.split_loggers = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594165] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] placement.timeout = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594306] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.auth_section = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594438] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.auth_type = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594567] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.cafile = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594695] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.certfile = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594829] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.collect_timing = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.594960] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.connect_retries = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.595103] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.connect_retry_delay = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.595236] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.enable_notifications = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.595365] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.endpoint_override = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.595496] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.insecure = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.595626] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.interface = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.595755] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.keyfile = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.595888] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.max_version = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596031] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.min_version = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596166] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.region_name = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596297] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.retriable_status_codes = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596426] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.service_name = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596553] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.service_type = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596756] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.split_loggers = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596813] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.status_code_retries = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.596929] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.status_code_retry_delay = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597064] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.timeout = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597196] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.valid_interfaces = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597321] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ironic.version = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597457] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] cli_script.dry_run = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597599] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597730] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597861] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.597992] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.598136] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.598265] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.598394] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.598523] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.598653] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.598791] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.598916] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.599063] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.599204] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.599337] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.599468] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.599604] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.599734] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.599865] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600013] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600147] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600277] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600406] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600534] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600663] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600791] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.600919] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601058] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601192] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601319] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601445] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601574] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.ssl = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601710] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601842] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.601972] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.602125] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.602260] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.602390] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.602527] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_notifications.driver = [] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.602661] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_notifications.retry = -1 {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.602808] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.602948] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.603081] env[65446]: DEBUG oslo_service.backend._eventlet.service [None req-d6a5b534-499a-49e3-b30a-76c2dc0ad132 None None] ******************************************************************************** {{(pid=65446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 532.604220] env[65446]: DEBUG neutron.agent.securitygroups_rpc [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Init firewall settings (driver=nsxv3) {{(pid=65446) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 532.605531] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65446) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 532.605772] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] RPC agent_id: nsxm-l-01a.corp.local [ 532.607975] env[65446]: DEBUG dogpile.cache.region [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 532.608112] env[65446]: DEBUG dogpile.lock [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 532.608205] env[65446]: DEBUG dogpile.lock [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 532.608294] env[65446]: DEBUG dogpile.lock [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 532.608387] env[65446]: DEBUG dogpile.cache.region [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 532.608471] env[65446]: DEBUG dogpile.lock [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 532.608592] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 532.628472] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Session token - acquiring [ 532.629948] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.630107] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.630211] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.630626] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.641060] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.916272] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 532.937685] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 532.937855] env[65446]: DEBUG dogpile.cache.region [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Cache value generated in 0.329 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 532.937941] env[65446]: DEBUG dogpile.lock [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 532.938078] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Activating Policy API Provider. [ 532.938271] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Looking for the default Infrastructure Rules. [ 533.007376] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Looking for the Default Layer3 Logged Drop Section. [ 533.024191] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 533.024662] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.024835] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.024938] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.025277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.025667] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.541170] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.046582] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.549138] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Inventory metadata is going to be refreshed. [ 534.549382] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 535.345695] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.346166] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.346166] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.346316] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.360793] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 535.362490] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.364504] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 535.387235] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.387499] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.387544] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.387898] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.387974] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.388105] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 535.388293] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.388515] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 535.410333] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.410565] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.410606] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.410931] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.411091] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.411240] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 535.432249] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.432538] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.432666] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.433187] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.433375] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.433526] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 535.454793] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.455118] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.455118] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.455443] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.455585] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.455735] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 535.455838] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.455940] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 535.476480] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.476743] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.476743] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.477056] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.477187] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.477334] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 535.477633] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.477789] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 535.500074] env[65446]: DEBUG networking_nsxv3.common.locking [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.500294] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.500364] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.500669] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.500813] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.500956] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 535.501096] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.501206] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Inventory metadata have been refreshed. [ 535.501268] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Dryrun:True. Metadata refresh completed. [ 535.501368] env[65446]: DEBUG oslo_concurrency.lockutils [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Releasing lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.503112] env[65446]: INFO neutron.agent.agent_extensions_manager [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Loaded agent extensions: [] [ 535.504313] env[65446]: DEBUG neutron_lib.callbacks.manager [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65446) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 535.561384] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent RPC Daemon Started! [ 535.561594] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:0 started [ 535.561697] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent out of sync with plugin! [ 540.505102] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.505480] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.506257] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.506749] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.508809] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.508809] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.513394] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9918edf2-1ac1-4c58-895e-3b063652fc59 demo admin] Enqueued Resource ID: af1151a3-616f-465f-9a04-c76ffe5a2d84 with Priority: HIGHEST for action security_group_rules [ 550.513704] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1151a3-616f-465f-9a04-c76ffe5a2d84 with Priority: HIGHEST for action security_group_rules [ 550.514047] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1151a3-616f-465f-9a04-c76ffe5a2d84 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.514213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1151a3-616f-465f-9a04-c76ffe5a2d84" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.514312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1151a3-616f-465f-9a04-c76ffe5a2d84" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.514691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1151a3-616f-465f-9a04-c76ffe5a2d84" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.514784] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1151a3-616f-465f-9a04-c76ffe5a2d84',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.034868] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.035110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.035110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.035305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.035372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.035461] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1151a3-616f-465f-9a04-c76ffe5a2d84 already deleted. [ 551.035541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1151a3-616f-465f-9a04-c76ffe5a2d84" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.515264] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.515700] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.516622] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.516622] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.517693] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.518103] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.519325] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.519707] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.522380] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.522629] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.273134] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d0a3215d-5d42-43e1-b26e-1adaa11cc789 None None] Enqueued Resource ID: f3fe3428-5e16-4f9a-9d92-b35ded14e999 with Priority: HIGHEST for action port [ 580.273665] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3fe3428-5e16-4f9a-9d92-b35ded14e999 with Priority: HIGHEST for action port [ 580.274640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3fe3428-5e16-4f9a-9d92-b35ded14e999 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.274640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3fe3428-5e16-4f9a-9d92-b35ded14e999" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.274640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3fe3428-5e16-4f9a-9d92-b35ded14e999" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.274640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3fe3428-5e16-4f9a-9d92-b35ded14e999" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.274640] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3fe3428-5e16-4f9a-9d92-b35ded14e999',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.777358] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3fe3428-5e16-4f9a-9d92-b35ded14e999 [ 580.777660] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.777801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.777888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.778132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.778223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.778330] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3fe3428-5e16-4f9a-9d92-b35ded14e999 already deleted. [ 580.778415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3fe3428-5e16-4f9a-9d92-b35ded14e999" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.230183] env[65446]: INFO networking_nsxv3.common.synchronization [None req-5a4085ae-f594-4243-8085-895acaff26f6 None None] Enqueued Resource ID: cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a with Priority: HIGHEST for action port [ 582.230488] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a with Priority: HIGHEST for action port [ 582.230488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.230634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.230697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.230907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.231051] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.738608] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a [ 582.738608] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.738608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.738608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.738968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.738968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.738968] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a already deleted. [ 582.738968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfeb0367-5d1b-4fe5-b9a9-57fc48490f5a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.423161] env[65446]: INFO networking_nsxv3.common.synchronization [None req-aa6490bb-628d-4455-adfd-0eb79da9f94b None None] Enqueued Resource ID: dd41bf44-8499-4c8f-b661-32f48ba43912 with Priority: HIGHEST for action port [ 583.423595] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd41bf44-8499-4c8f-b661-32f48ba43912 with Priority: HIGHEST for action port [ 583.423912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd41bf44-8499-4c8f-b661-32f48ba43912 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.424065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd41bf44-8499-4c8f-b661-32f48ba43912" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.424174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd41bf44-8499-4c8f-b661-32f48ba43912" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.424374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd41bf44-8499-4c8f-b661-32f48ba43912" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.424446] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd41bf44-8499-4c8f-b661-32f48ba43912',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.926234] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd41bf44-8499-4c8f-b661-32f48ba43912 [ 583.926485] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.926628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.926696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.926930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.927032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.927205] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd41bf44-8499-4c8f-b661-32f48ba43912 already deleted. [ 583.927205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd41bf44-8499-4c8f-b661-32f48ba43912" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.148632] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c6ec6f5a-b128-400d-9583-155ce6baf9c6 None None] Enqueued Resource ID: 9771f984-51ed-46ae-b280-33a6a970cb7d with Priority: HIGHEST for action port [ 584.148892] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9771f984-51ed-46ae-b280-33a6a970cb7d with Priority: HIGHEST for action port [ 584.150875] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-9771f984-51ed-46ae-b280-33a6a970cb7d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.150875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9771f984-51ed-46ae-b280-33a6a970cb7d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.150875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9771f984-51ed-46ae-b280-33a6a970cb7d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.150875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9771f984-51ed-46ae-b280-33a6a970cb7d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.150875] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9771f984-51ed-46ae-b280-33a6a970cb7d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.656363] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9771f984-51ed-46ae-b280-33a6a970cb7d [ 584.656595] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.656763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.656854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.657154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.657278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.657320] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9771f984-51ed-46ae-b280-33a6a970cb7d already deleted. [ 584.657394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9771f984-51ed-46ae-b280-33a6a970cb7d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.065246] env[65446]: INFO networking_nsxv3.common.synchronization [None req-55561346-38c3-46de-896c-124b8d08a6de None None] Enqueued Resource ID: 6876f78b-f961-455b-82d4-bf3cc380fe74 with Priority: HIGHEST for action port [ 585.066970] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6876f78b-f961-455b-82d4-bf3cc380fe74 with Priority: HIGHEST for action port [ 585.067427] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6876f78b-f961-455b-82d4-bf3cc380fe74 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.067782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6876f78b-f961-455b-82d4-bf3cc380fe74" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.069469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6876f78b-f961-455b-82d4-bf3cc380fe74" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.069469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6876f78b-f961-455b-82d4-bf3cc380fe74" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.069469] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6876f78b-f961-455b-82d4-bf3cc380fe74',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.571137] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6876f78b-f961-455b-82d4-bf3cc380fe74 [ 585.571571] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.571785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.571980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.572311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.572427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.572542] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6876f78b-f961-455b-82d4-bf3cc380fe74 already deleted. [ 585.572695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6876f78b-f961-455b-82d4-bf3cc380fe74" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.975212] env[65446]: INFO networking_nsxv3.common.synchronization [None req-01cd91e8-b143-4016-aa81-0b7807f04871 None None] Enqueued Resource ID: f2c891b9-e8be-4211-ae9e-e071ffa1a782 with Priority: HIGHEST for action port [ 585.975496] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c891b9-e8be-4211-ae9e-e071ffa1a782 with Priority: HIGHEST for action port [ 585.975722] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c891b9-e8be-4211-ae9e-e071ffa1a782 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.975833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c891b9-e8be-4211-ae9e-e071ffa1a782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.975833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c891b9-e8be-4211-ae9e-e071ffa1a782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.976091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c891b9-e8be-4211-ae9e-e071ffa1a782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.976172] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c891b9-e8be-4211-ae9e-e071ffa1a782',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.173021] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c04d059c-7b55-4a4c-9964-f78aaeda7805 None None] Enqueued Resource ID: 12f2707d-cf76-4244-b74a-a6bbb831b099 with Priority: HIGHEST for action port [ 586.173021] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f2707d-cf76-4244-b74a-a6bbb831b099 with Priority: HIGHEST for action port [ 586.173021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-12f2707d-cf76-4244-b74a-a6bbb831b099 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.173021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12f2707d-cf76-4244-b74a-a6bbb831b099" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.173021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12f2707d-cf76-4244-b74a-a6bbb831b099" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.173021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12f2707d-cf76-4244-b74a-a6bbb831b099" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.173021] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f2707d-cf76-4244-b74a-a6bbb831b099',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.479567] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2c891b9-e8be-4211-ae9e-e071ffa1a782 [ 586.479955] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.480183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.480256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.480472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.480561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.480657] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2c891b9-e8be-4211-ae9e-e071ffa1a782 already deleted. [ 586.480734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c891b9-e8be-4211-ae9e-e071ffa1a782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.507606] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.507719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.507793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.507993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.508233] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.678758] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12f2707d-cf76-4244-b74a-a6bbb831b099 [ 586.679123] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.679282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.679376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.679660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.679800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.679904] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12f2707d-cf76-4244-b74a-a6bbb831b099 already deleted. [ 586.679987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12f2707d-cf76-4244-b74a-a6bbb831b099" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.013240] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.516239] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.022976] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 588.022976] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 588.083568] env[65446]: INFO networking_nsxv3.common.synchronization [None req-ae6ed609-3195-4c87-be0a-e211a691935d None None] Enqueued Resource ID: dfcd35a5-b017-4e55-91ba-a8e2c4b911bf with Priority: HIGHEST for action port [ 588.083568] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfcd35a5-b017-4e55-91ba-a8e2c4b911bf with Priority: HIGHEST for action port [ 588.083774] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfcd35a5-b017-4e55-91ba-a8e2c4b911bf taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.083983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfcd35a5-b017-4e55-91ba-a8e2c4b911bf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.083983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfcd35a5-b017-4e55-91ba-a8e2c4b911bf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.086283] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfcd35a5-b017-4e55-91ba-a8e2c4b911bf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.086373] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfcd35a5-b017-4e55-91ba-a8e2c4b911bf',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.589984] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfcd35a5-b017-4e55-91ba-a8e2c4b911bf [ 588.590235] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.590375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.590375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.590658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.590747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.590840] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfcd35a5-b017-4e55-91ba-a8e2c4b911bf already deleted. [ 588.590921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfcd35a5-b017-4e55-91ba-a8e2c4b911bf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.660227] env[65446]: INFO networking_nsxv3.common.synchronization [None req-0b269f78-aba2-4bf7-a434-2ae639d0c5d7 None None] Enqueued Resource ID: 3f3ea393-2115-4253-962a-b24a22134534 with Priority: HIGHEST for action port [ 588.660781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f3ea393-2115-4253-962a-b24a22134534 with Priority: HIGHEST for action port [ 588.661041] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f3ea393-2115-4253-962a-b24a22134534 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.661294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f3ea393-2115-4253-962a-b24a22134534" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.661294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f3ea393-2115-4253-962a-b24a22134534" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.662326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f3ea393-2115-4253-962a-b24a22134534" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.662405] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f3ea393-2115-4253-962a-b24a22134534',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.856613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.856900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.856900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.857146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.872542] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 588.874577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.875423] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 588.897608] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.899539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.899539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.899539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.899539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.899539] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 588.899539] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 588.899539] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 588.924021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.924021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.924021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.924021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.924021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.924021] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 588.948382] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.948382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.948382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.948677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.948677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.948677] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 588.974347] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.974534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.974669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.974919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.975075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.975237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 588.975315] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 588.975387] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 588.998754] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.999011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.999140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.999450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.999593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.999777] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 588.999896] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 588.999981] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 589.022034] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.022034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.022034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.022250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.022304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.022544] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 589.022544] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 589.022544] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 589.022660] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 589.022660] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 589.022719] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 589.022788] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 589.023073] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 589.023323] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 589.023323] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 589.051483] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.051483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.051727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.051766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.051876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.052404] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 589.075109] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.075558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.075706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.075977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.076417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.109934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.167085] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f3ea393-2115-4253-962a-b24a22134534 [ 589.167330] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.167466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.167536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.167742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.167830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.167924] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f3ea393-2115-4253-962a-b24a22134534 already deleted. [ 589.168014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f3ea393-2115-4253-962a-b24a22134534" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.294538] env[65446]: INFO networking_nsxv3.common.synchronization [None req-6d190374-6b94-4fa5-9f17-0513d8ac04e6 None None] Enqueued Resource ID: 2217c9cd-1784-4049-8a6f-68dcd456cfb1 with Priority: HIGHEST for action port [ 589.295292] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2217c9cd-1784-4049-8a6f-68dcd456cfb1 with Priority: HIGHEST for action port [ 589.296044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2217c9cd-1784-4049-8a6f-68dcd456cfb1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.296202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2217c9cd-1784-4049-8a6f-68dcd456cfb1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.296650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2217c9cd-1784-4049-8a6f-68dcd456cfb1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.296924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2217c9cd-1784-4049-8a6f-68dcd456cfb1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.296954] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2217c9cd-1784-4049-8a6f-68dcd456cfb1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.800090] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2217c9cd-1784-4049-8a6f-68dcd456cfb1 [ 589.800090] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.800288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.800288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.800797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.800797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.800797] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2217c9cd-1784-4049-8a6f-68dcd456cfb1 already deleted. [ 589.800797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2217c9cd-1784-4049-8a6f-68dcd456cfb1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.080697] env[65446]: INFO networking_nsxv3.common.synchronization [None req-f277b002-8f04-44c4-bbe2-2a6dd114d97d None None] Enqueued Resource ID: 41ccab58-8ce2-4069-b554-f759db9ee64c with Priority: HIGHEST for action port [ 590.080697] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ccab58-8ce2-4069-b554-f759db9ee64c with Priority: HIGHEST for action port [ 590.080697] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-41ccab58-8ce2-4069-b554-f759db9ee64c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.080697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41ccab58-8ce2-4069-b554-f759db9ee64c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.080697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41ccab58-8ce2-4069-b554-f759db9ee64c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.082169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41ccab58-8ce2-4069-b554-f759db9ee64c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.082419] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ccab58-8ce2-4069-b554-f759db9ee64c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.591972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41ccab58-8ce2-4069-b554-f759db9ee64c [ 590.591972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.591972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.591972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.592213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.592349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.592444] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41ccab58-8ce2-4069-b554-f759db9ee64c already deleted. [ 590.592547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41ccab58-8ce2-4069-b554-f759db9ee64c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.094665] env[65446]: INFO networking_nsxv3.common.synchronization [None req-03fd949d-1ee7-4e04-9b3f-f3d97bc6320c None None] Enqueued Resource ID: ade5e9ab-a6d8-4815-8a77-e72709d75ebf with Priority: HIGHEST for action port [ 591.095312] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ade5e9ab-a6d8-4815-8a77-e72709d75ebf with Priority: HIGHEST for action port [ 591.095870] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ade5e9ab-a6d8-4815-8a77-e72709d75ebf taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.095870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ade5e9ab-a6d8-4815-8a77-e72709d75ebf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.097082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ade5e9ab-a6d8-4815-8a77-e72709d75ebf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.097394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ade5e9ab-a6d8-4815-8a77-e72709d75ebf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.097490] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ade5e9ab-a6d8-4815-8a77-e72709d75ebf',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.516225] env[65446]: INFO networking_nsxv3.common.synchronization [None req-b11427e3-b2ad-433f-a604-f087e78d8be0 tempest-ServersTestManualDisk-1783414972 tempest-ServersTestManualDisk-1783414972-project-member] Enqueued Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_rules [ 591.516813] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_rules [ 591.517071] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.517203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.518257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.518257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.518257] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.601765] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ade5e9ab-a6d8-4815-8a77-e72709d75ebf [ 591.601765] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.601765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.601765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.601765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.601765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.601765] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ade5e9ab-a6d8-4815-8a77-e72709d75ebf already deleted. [ 591.601765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ade5e9ab-a6d8-4815-8a77-e72709d75ebf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.863665] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4c90b1af-73d1-4d13-b853-dc1b418a7f79 tempest-ServersTestManualDisk-1783414972 tempest-ServersTestManualDisk-1783414972-project-member] Enqueued Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_rules [ 591.864158] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_rules [ 591.864360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.864826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.046221] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.049321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.049321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.049321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.049321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.049321] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 already deleted. [ 592.049321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.049321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.049321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.049321] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.111830] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c9110593-1ae2-47df-906b-932491fd0ade None None] Enqueued Resource ID: 74513d2f-8479-4313-a77b-5461c53c9df3 with Priority: HIGHEST for action port [ 592.113759] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74513d2f-8479-4313-a77b-5461c53c9df3 with Priority: HIGHEST for action port [ 592.113759] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-74513d2f-8479-4313-a77b-5461c53c9df3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.113759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74513d2f-8479-4313-a77b-5461c53c9df3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.113759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74513d2f-8479-4313-a77b-5461c53c9df3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.113759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74513d2f-8479-4313-a77b-5461c53c9df3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.113759] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74513d2f-8479-4313-a77b-5461c53c9df3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.570609] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.571898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.571898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.571898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.571898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.571898] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 already deleted. [ 592.571898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.615870] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74513d2f-8479-4313-a77b-5461c53c9df3 [ 592.616344] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.616538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.616607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.617020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.617020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.617020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74513d2f-8479-4313-a77b-5461c53c9df3 already deleted. [ 592.617142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74513d2f-8479-4313-a77b-5461c53c9df3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.102441] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e58d4a4c-8d73-4269-a1d6-1cf4d6274036 None None] Enqueued Resource ID: a7b75013-9288-45e0-840f-ad6512b121b0 with Priority: HIGHEST for action port [ 593.103120] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b75013-9288-45e0-840f-ad6512b121b0 with Priority: HIGHEST for action port [ 593.103479] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7b75013-9288-45e0-840f-ad6512b121b0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.103964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7b75013-9288-45e0-840f-ad6512b121b0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.104129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7b75013-9288-45e0-840f-ad6512b121b0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.104481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7b75013-9288-45e0-840f-ad6512b121b0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.104599] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7b75013-9288-45e0-840f-ad6512b121b0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.399140] env[65446]: INFO networking_nsxv3.common.synchronization [None req-77157463-5741-49f0-ad79-2429609b432f None None] Enqueued Resource ID: e2f739a8-fa56-4947-8dc7-4e0e1f758eca with Priority: HIGHEST for action port [ 593.400101] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f739a8-fa56-4947-8dc7-4e0e1f758eca with Priority: HIGHEST for action port [ 593.400229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2f739a8-fa56-4947-8dc7-4e0e1f758eca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.400398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2f739a8-fa56-4947-8dc7-4e0e1f758eca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.400473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2f739a8-fa56-4947-8dc7-4e0e1f758eca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.400961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2f739a8-fa56-4947-8dc7-4e0e1f758eca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.401287] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2f739a8-fa56-4947-8dc7-4e0e1f758eca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.609736] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7b75013-9288-45e0-840f-ad6512b121b0 [ 593.609736] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.609736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.609736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.609736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.610060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.610060] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7b75013-9288-45e0-840f-ad6512b121b0 already deleted. [ 593.610060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7b75013-9288-45e0-840f-ad6512b121b0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.906505] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2f739a8-fa56-4947-8dc7-4e0e1f758eca [ 593.906790] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.907325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.907325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.907325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.907464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.907464] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2f739a8-fa56-4947-8dc7-4e0e1f758eca already deleted. [ 593.907543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2f739a8-fa56-4947-8dc7-4e0e1f758eca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.396682] env[65446]: INFO networking_nsxv3.common.synchronization [req-ecb64326-b89a-4de7-becf-412210b4196a req-216bbfcc-72da-4665-a4b6-0dcfb6df89de tempest-DeleteServersAdminTestJSON-331057081 tempest-DeleteServersAdminTestJSON-331057081-project-member] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 594.397363] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 594.397790] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.397968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.398824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.399163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.399402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.399528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.399630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.399849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.399947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.400102] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.904927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.905189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.905189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.905402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.905501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.907832] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.908125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.908125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.908489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.908489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.908600] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 already deleted. [ 594.908600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.058419] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.058751] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.058751] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.060752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.060752] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.060752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.060752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.060752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.060752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.061123] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.061123] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.061123] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.061123] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.061252] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.062258] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.062258] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.082511] env[65446]: INFO networking_nsxv3.common.synchronization [None req-00d37952-8169-4935-b907-38603d31917f None None] Enqueued Resource ID: 9d37b00a-3a86-491d-807a-6f15f42beddc with Priority: HIGHEST for action port [ 596.083667] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d37b00a-3a86-491d-807a-6f15f42beddc with Priority: HIGHEST for action port [ 596.084060] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d37b00a-3a86-491d-807a-6f15f42beddc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.085243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d37b00a-3a86-491d-807a-6f15f42beddc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.085243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d37b00a-3a86-491d-807a-6f15f42beddc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.085243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d37b00a-3a86-491d-807a-6f15f42beddc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.085243] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d37b00a-3a86-491d-807a-6f15f42beddc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.087742] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.088029] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.088122] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.088225] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.088532] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-4e9a8d72-c337-4134-9639-0bec5d8a697f taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.088695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.088833] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.089309] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.089309] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e9a8d72-c337-4134-9639-0bec5d8a697f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.586830] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d37b00a-3a86-491d-807a-6f15f42beddc [ 596.588434] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.588434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.588434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.588434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.588434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.588434] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d37b00a-3a86-491d-807a-6f15f42beddc already deleted. [ 596.588434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d37b00a-3a86-491d-807a-6f15f42beddc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.598051] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.598051] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 4e9a8d72-c337-4134-9639-0bec5d8a697f not found, creating... [ 596.598051] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.598051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.599379] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.599379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.599379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.599379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.599379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.599379] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 4e9a8d72-c337-4134-9639-0bec5d8a697f is going to be created. [ 596.625699] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.626907] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.627135] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.627428] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.627660] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.627900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.377897] env[65446]: INFO networking_nsxv3.common.synchronization [None req-f628d342-10ed-4371-86d6-d218ce9319c2 None None] Enqueued Resource ID: c6a24364-6339-420b-bcd6-f660b41fccab with Priority: HIGHEST for action port [ 597.378593] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a24364-6339-420b-bcd6-f660b41fccab with Priority: HIGHEST for action port [ 597.379315] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6a24364-6339-420b-bcd6-f660b41fccab taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.379315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6a24364-6339-420b-bcd6-f660b41fccab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.379315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6a24364-6339-420b-bcd6-f660b41fccab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.379966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6a24364-6339-420b-bcd6-f660b41fccab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.380067] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6a24364-6339-420b-bcd6-f660b41fccab',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.472712] env[65446]: INFO networking_nsxv3.common.synchronization [req-ecb64326-b89a-4de7-becf-412210b4196a req-b8746f19-3d8c-4fcb-a6cc-5964e23b1e2f service nova] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_rules [ 597.472907] env[65446]: INFO networking_nsxv3.common.synchronization [req-ecb64326-b89a-4de7-becf-412210b4196a req-b8746f19-3d8c-4fcb-a6cc-5964e23b1e2f service nova] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 597.473278] env[65446]: INFO networking_nsxv3.common.synchronization [req-ecb64326-b89a-4de7-becf-412210b4196a req-b8746f19-3d8c-4fcb-a6cc-5964e23b1e2f service nova] Enqueued Resource ID: 4e9a8d72-c337-4134-9639-0bec5d8a697f with Priority: HIGHEST for action port [ 597.473625] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_rules [ 597.475123] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 597.475123] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9a8d72-c337-4134-9639-0bec5d8a697f with Priority: HIGHEST for action port [ 597.475123] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.475123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.475123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.475123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.475123] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.475887] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.476023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.479282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.479528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.479755] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.479856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.479900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.480063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.480395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.480395] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.482293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e9a8d72-c337-4134-9639-0bec5d8a697f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.482293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.482293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.482293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.482293] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e9a8d72-c337-4134-9639-0bec5d8a697f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.669566] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e69c6f99-4dd2-4b08-9dc3-7b6c72eae364 None None] Enqueued Resource ID: b84f8345-ec1a-4df3-8c81-a43b2a09b620 with Priority: HIGHEST for action port [ 597.670209] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84f8345-ec1a-4df3-8c81-a43b2a09b620 with Priority: HIGHEST for action port [ 597.670518] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b84f8345-ec1a-4df3-8c81-a43b2a09b620 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.670639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b84f8345-ec1a-4df3-8c81-a43b2a09b620" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.670783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b84f8345-ec1a-4df3-8c81-a43b2a09b620" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.670972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b84f8345-ec1a-4df3-8c81-a43b2a09b620" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.671084] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b84f8345-ec1a-4df3-8c81-a43b2a09b620',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.883545] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6a24364-6339-420b-bcd6-f660b41fccab [ 597.883790] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.883931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.884615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.885161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.886430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.886430] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6a24364-6339-420b-bcd6-f660b41fccab already deleted. [ 597.886430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6a24364-6339-420b-bcd6-f660b41fccab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.984823] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.984988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.002879] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.004545] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e9a8d72-c337-4134-9639-0bec5d8a697f with status ACTIVE [ 598.004917] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.005046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.005085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.005282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.005371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.005550] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.005649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.005714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.005860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.005938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.006603] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.006711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.006798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.006953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.007046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.007274] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e9a8d72-c337-4134-9639-0bec5d8a697f is going to be updated. [ 598.027887] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.030026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.030353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.030353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.031038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.031038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e9a8d72-c337-4134-9639-0bec5d8a697f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.067783] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c66fd4bc-2942-424e-9374-1821cb646a98 None None] Enqueued Resource ID: 8e27b1f4-4e57-4394-a642-88ed094ba0b8 with Priority: HIGHEST for action port [ 598.067783] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e27b1f4-4e57-4394-a642-88ed094ba0b8 with Priority: HIGHEST for action port [ 598.067783] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e27b1f4-4e57-4394-a642-88ed094ba0b8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.067783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e27b1f4-4e57-4394-a642-88ed094ba0b8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.067783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e27b1f4-4e57-4394-a642-88ed094ba0b8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.067783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e27b1f4-4e57-4394-a642-88ed094ba0b8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.067783] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e27b1f4-4e57-4394-a642-88ed094ba0b8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.172948] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b84f8345-ec1a-4df3-8c81-a43b2a09b620 [ 598.174092] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.174092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.174092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.174469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.174783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.175491] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b84f8345-ec1a-4df3-8c81-a43b2a09b620 already deleted. [ 598.175491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b84f8345-ec1a-4df3-8c81-a43b2a09b620" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.510289] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.571298] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e27b1f4-4e57-4394-a642-88ed094ba0b8 [ 598.571476] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.571652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.571652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.571848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.571937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.572075] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e27b1f4-4e57-4394-a642-88ed094ba0b8 already deleted. [ 598.572136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e27b1f4-4e57-4394-a642-88ed094ba0b8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.013563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.013563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.013563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.013733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.013733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.013839] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be created. [ 599.052610] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.052781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.052833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.053064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.053226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.065070] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: UNINITIALIZED for 2s [ 599.527637] env[65446]: INFO networking_nsxv3.common.synchronization [None req-ea9bde10-e40f-4893-86a7-e3d054f899bd None None] Enqueued Resource ID: 1d49b577-99fd-40a7-9409-d91aaa74360a with Priority: HIGHEST for action port [ 599.528661] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d49b577-99fd-40a7-9409-d91aaa74360a with Priority: HIGHEST for action port [ 599.528997] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d49b577-99fd-40a7-9409-d91aaa74360a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.529138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d49b577-99fd-40a7-9409-d91aaa74360a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.529275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d49b577-99fd-40a7-9409-d91aaa74360a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.530276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d49b577-99fd-40a7-9409-d91aaa74360a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.530276] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d49b577-99fd-40a7-9409-d91aaa74360a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.034349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d49b577-99fd-40a7-9409-d91aaa74360a [ 600.034609] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.034751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.034836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.035053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.035197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.035357] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d49b577-99fd-40a7-9409-d91aaa74360a already deleted. [ 600.035496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d49b577-99fd-40a7-9409-d91aaa74360a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.608134] env[65446]: INFO networking_nsxv3.common.synchronization [None req-feb23af4-ed9e-4c70-b8bd-495eabd325a6 None None] Enqueued Resource ID: 31bdcaf4-36c1-492e-b699-2653ac0a90a8 with Priority: HIGHEST for action port [ 600.608429] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31bdcaf4-36c1-492e-b699-2653ac0a90a8 with Priority: HIGHEST for action port [ 600.608938] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-31bdcaf4-36c1-492e-b699-2653ac0a90a8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.609074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31bdcaf4-36c1-492e-b699-2653ac0a90a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.609148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31bdcaf4-36c1-492e-b699-2653ac0a90a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.609394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31bdcaf4-36c1-492e-b699-2653ac0a90a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.612455] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31bdcaf4-36c1-492e-b699-2653ac0a90a8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.741955] env[65446]: INFO networking_nsxv3.common.synchronization [None req-bde61876-4aa1-4729-87df-024c45ca6e64 None None] Enqueued Resource ID: fb6930b1-c7b7-4ae8-a17b-97c48bb597e2 with Priority: HIGHEST for action port [ 600.742655] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6930b1-c7b7-4ae8-a17b-97c48bb597e2 with Priority: HIGHEST for action port [ 600.743253] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6930b1-c7b7-4ae8-a17b-97c48bb597e2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.743253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6930b1-c7b7-4ae8-a17b-97c48bb597e2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.743253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6930b1-c7b7-4ae8-a17b-97c48bb597e2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.743521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6930b1-c7b7-4ae8-a17b-97c48bb597e2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.743572] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6930b1-c7b7-4ae8-a17b-97c48bb597e2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.078160] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: SUCCESS [ 601.078433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.078634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.078870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.079088] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.079197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.079285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.080125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.080125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.080125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.080125] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.115175] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31bdcaf4-36c1-492e-b699-2653ac0a90a8 [ 601.115432] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.115555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.115660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.115888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.115984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.116085] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31bdcaf4-36c1-492e-b699-2653ac0a90a8 already deleted. [ 601.116205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31bdcaf4-36c1-492e-b699-2653ac0a90a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.248098] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb6930b1-c7b7-4ae8-a17b-97c48bb597e2 [ 601.248098] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.248098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.248098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.248098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.248295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.248295] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb6930b1-c7b7-4ae8-a17b-97c48bb597e2 already deleted. [ 601.248364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6930b1-c7b7-4ae8-a17b-97c48bb597e2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.552332] env[65446]: INFO networking_nsxv3.common.synchronization [None req-80937efd-7b61-47bf-af2d-d061aa78771c tempest-VolumesAssistedSnapshotsTest-973014014 tempest-VolumesAssistedSnapshotsTest-973014014-project-member] Enqueued Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_rules [ 601.554821] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_rules [ 601.554821] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.554821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.554821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.554821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.554821] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.582567] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.582727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.582795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.583778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.584411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.584534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.584599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.584780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.584865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.584953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.585292] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.585402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.585464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.585615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.585764] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.585857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.585932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.587162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.587162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.587162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.587162] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.669113] env[65446]: INFO networking_nsxv3.common.synchronization [None req-eda244d1-c12b-4291-8c6e-f6e4b62fa38d tempest-VolumesAssistedSnapshotsTest-973014014 tempest-VolumesAssistedSnapshotsTest-973014014-project-member] Enqueued Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_rules [ 601.669841] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_rules [ 601.670553] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.670553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.079033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.079033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.079033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.079033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.079033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.079033] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 already deleted. [ 602.079033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.079033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.079033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.079033] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.088997] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8ff462b-9472-43fc-a79a-f055dbe02c56: rpc.has_security_group_logging(os_id): False [ 602.112634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.112634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.112634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.112634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.113150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.113150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.114405] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.114405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.114405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.114405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.114405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.114405] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be created. [ 602.210294] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.210294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.210294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.210294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.210294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.237833] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: IN_PROGRESS for 2s [ 602.257931] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4561ea5f-ea20-47a5-b0a1-21fc3b42429c None None] Enqueued Resource ID: 37cf0bad-72f1-4804-a533-0f51e5f6b5a7 with Priority: HIGHEST for action port [ 602.258610] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37cf0bad-72f1-4804-a533-0f51e5f6b5a7 with Priority: HIGHEST for action port [ 602.258873] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-37cf0bad-72f1-4804-a533-0f51e5f6b5a7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.258999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37cf0bad-72f1-4804-a533-0f51e5f6b5a7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.259131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37cf0bad-72f1-4804-a533-0f51e5f6b5a7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.259418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37cf0bad-72f1-4804-a533-0f51e5f6b5a7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.259528] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37cf0bad-72f1-4804-a533-0f51e5f6b5a7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.608169] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.613215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.613215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.613215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.613215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.613215] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 already deleted. [ 602.613215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.762915] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37cf0bad-72f1-4804-a533-0f51e5f6b5a7 [ 602.764981] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.764981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.764981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.765216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.765252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.765349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37cf0bad-72f1-4804-a533-0f51e5f6b5a7 already deleted. [ 602.765466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37cf0bad-72f1-4804-a533-0f51e5f6b5a7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.546583] env[65446]: INFO networking_nsxv3.common.synchronization [req-87dd0b75-905e-443d-adbe-9b2d3fe54d98 req-7a79dd71-efd8-4018-ae44-89219eb2dccb tempest-MigrationsAdminTest-1736177509 tempest-MigrationsAdminTest-1736177509-project-member] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 603.547145] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 603.547462] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.547855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.548157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.548372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.548588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.548738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.548841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.550137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.550137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.550137] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.052364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.052684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.052684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.055464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.055464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.055464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.055464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.055464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.055464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.055464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.055464] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 already deleted. [ 604.055464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.199909] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.200973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.200973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.205074] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.205074] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.205231] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.205311] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.206371] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.206371] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.206371] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.206371] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.206371] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.206371] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.206371] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.206754] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.206754] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.228932] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.229111] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.229249] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.229708] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.229787] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-1f70b991-c289-46db-b337-b21f84cf9137 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.229894] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.230016] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.231021] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.231021] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f70b991-c289-46db-b337-b21f84cf9137',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.257566] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: SUCCESS [ 604.257874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.642903] env[65446]: INFO networking_nsxv3.common.synchronization [None req-1927dd37-f57c-4ee4-a64a-fa5cebd8d4e5 None None] Enqueued Resource ID: 548b894f-f772-46fd-b4f0-325aa4e96474 with Priority: HIGHEST for action port [ 604.643225] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 548b894f-f772-46fd-b4f0-325aa4e96474 with Priority: HIGHEST for action port [ 604.643809] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-548b894f-f772-46fd-b4f0-325aa4e96474 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.643896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-548b894f-f772-46fd-b4f0-325aa4e96474" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.644012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-548b894f-f772-46fd-b4f0-325aa4e96474" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.644305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-548b894f-f772-46fd-b4f0-325aa4e96474" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.644489] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('548b894f-f772-46fd-b4f0-325aa4e96474',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.664313] env[65446]: INFO networking_nsxv3.common.synchronization [None req-380d9700-6625-4d27-851b-f0aa3b1dfda6 None None] Enqueued Resource ID: 1d28d64f-42d5-4cae-91ac-bd2545356194 with Priority: HIGHEST for action port [ 604.664313] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d28d64f-42d5-4cae-91ac-bd2545356194 with Priority: HIGHEST for action port [ 604.664313] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d28d64f-42d5-4cae-91ac-bd2545356194 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.664313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d28d64f-42d5-4cae-91ac-bd2545356194" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.664313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d28d64f-42d5-4cae-91ac-bd2545356194" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.664313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d28d64f-42d5-4cae-91ac-bd2545356194" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.664313] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d28d64f-42d5-4cae-91ac-bd2545356194',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.735747] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.735956] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.736095] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.736369] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.736518] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.736668] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 1f70b991-c289-46db-b337-b21f84cf9137 not found, creating... [ 604.736933] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.737108] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.737249] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.737490] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.737632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.737903] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.738069] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.738184] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.738391] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.738519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.738657] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 1f70b991-c289-46db-b337-b21f84cf9137 is going to be created. [ 604.767023] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.767023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.767023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.767023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.767023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.767023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.147399] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 548b894f-f772-46fd-b4f0-325aa4e96474 [ 605.147686] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.147842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.147842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.148222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.148222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.148222] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:548b894f-f772-46fd-b4f0-325aa4e96474 already deleted. [ 605.148502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-548b894f-f772-46fd-b4f0-325aa4e96474" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.168409] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d28d64f-42d5-4cae-91ac-bd2545356194 [ 605.168665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.168802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.168877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.169109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.169202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.169300] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d28d64f-42d5-4cae-91ac-bd2545356194 already deleted. [ 605.169382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d28d64f-42d5-4cae-91ac-bd2545356194" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.315198] env[65446]: INFO networking_nsxv3.common.synchronization [req-b9932416-9142-4c70-9a83-bb5735413d35 req-5e1e4f6f-cd77-47e8-9c0e-21d08e5c46a3 tempest-InstanceActionsV221TestJSON-1825224203 tempest-InstanceActionsV221TestJSON-1825224203-project-member] Enqueued Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_members [ 605.315198] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_members [ 605.315532] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.315662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.315727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.316176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.316905] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.316905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.316905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.316905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.317129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.317160] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.638027] env[65446]: INFO networking_nsxv3.common.synchronization [req-87dd0b75-905e-443d-adbe-9b2d3fe54d98 req-e7df0de2-1998-447a-a9f0-e89b74ff0561 service nova] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_rules [ 605.638027] env[65446]: INFO networking_nsxv3.common.synchronization [req-87dd0b75-905e-443d-adbe-9b2d3fe54d98 req-e7df0de2-1998-447a-a9f0-e89b74ff0561 service nova] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 605.638027] env[65446]: INFO networking_nsxv3.common.synchronization [req-87dd0b75-905e-443d-adbe-9b2d3fe54d98 req-e7df0de2-1998-447a-a9f0-e89b74ff0561 service nova] Enqueued Resource ID: 1f70b991-c289-46db-b337-b21f84cf9137 with Priority: HIGHEST for action port [ 605.638205] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_rules [ 605.638205] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 605.638310] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f70b991-c289-46db-b337-b21f84cf9137 with Priority: HIGHEST for action port [ 605.638867] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.638991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.639592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.639856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.639942] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.641177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.641177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.641352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.641755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.641964] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.642130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.642969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.643407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.643407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.643629] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.644680] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f70b991-c289-46db-b337-b21f84cf9137 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.645668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.645668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.645668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.645668] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f70b991-c289-46db-b337-b21f84cf9137',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.718900] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-476 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.719120] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-476" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.719240] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-476" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.719606] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-476" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.719878] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.720045] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.720769] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.720769] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.720769] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.720769] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.720980] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.720980] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.721061] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.721165] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.721274] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.721399] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.758669] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.758669] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.758669] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.758962] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-476" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.759179] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-16cb0ed0-2606-4548-ba71-fd360978a69a taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.760170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.760170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.760170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.760758] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cb0ed0-2606-4548-ba71-fd360978a69a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.819782] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.821234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.821557] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 already deleted. [ 605.821557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.907354] env[65446]: INFO networking_nsxv3.common.synchronization [req-45b608c5-f57a-4f10-a5b6-445df98798ca req-fc315fd1-3725-44a9-832b-469f5e560fc3 tempest-SecurityGroupRulesTestJSON-1365411131 tempest-SecurityGroupRulesTestJSON-1365411131-project-member] Enqueued Resource ID: 344da004-4bb4-48c5-9278-9d0b67a00323 with Priority: HIGHEST for action security_group_rules [ 605.908128] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 344da004-4bb4-48c5-9278-9d0b67a00323 with Priority: HIGHEST for action security_group_rules [ 605.908553] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-344da004-4bb4-48c5-9278-9d0b67a00323 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.908553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-344da004-4bb4-48c5-9278-9d0b67a00323" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.908679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-344da004-4bb4-48c5-9278-9d0b67a00323" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.908909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-344da004-4bb4-48c5-9278-9d0b67a00323" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.909020] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('344da004-4bb4-48c5-9278-9d0b67a00323',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.148658] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.149077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.149515] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.150464] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f70b991-c289-46db-b337-b21f84cf9137 with status ACTIVE [ 606.150636] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.150858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.150858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.151673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.151673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.151673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.151673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.151673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.151673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.151673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.152483] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.153022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.153022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.153022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.153149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.153149] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f70b991-c289-46db-b337-b21f84cf9137 is going to be updated. [ 606.182227] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.182227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.182227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.183536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.183794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.184858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f70b991-c289-46db-b337-b21f84cf9137" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.186265] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4c6b2dd7-05f3-468e-9452-0006fa5ffa01 None None] Enqueued Resource ID: 03ebea06-63b5-4bd8-b50a-443663efbb16 with Priority: HIGHEST for action port [ 606.186916] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03ebea06-63b5-4bd8-b50a-443663efbb16 with Priority: HIGHEST for action port [ 606.187629] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-03ebea06-63b5-4bd8-b50a-443663efbb16 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.187629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03ebea06-63b5-4bd8-b50a-443663efbb16" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.187629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03ebea06-63b5-4bd8-b50a-443663efbb16" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.187836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03ebea06-63b5-4bd8-b50a-443663efbb16" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.187836] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ebea06-63b5-4bd8-b50a-443663efbb16',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.263936] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.263936] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.264233] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.265354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.265354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.265354] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 16cb0ed0-2606-4548-ba71-fd360978a69a not found, creating... [ 606.265544] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.265695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.265805] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.266242] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.266550] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.266732] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.266888] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.266998] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.267248] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.267378] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.267524] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 16cb0ed0-2606-4548-ba71-fd360978a69a is going to be created. [ 606.292864] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.292864] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.293115] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.293231] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.293468] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.293691] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.438711] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.438928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.439021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.439283] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.439384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.439519] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 344da004-4bb4-48c5-9278-9d0b67a00323 already deleted. [ 606.439621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-344da004-4bb4-48c5-9278-9d0b67a00323" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.655917] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.693222] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03ebea06-63b5-4bd8-b50a-443663efbb16 [ 606.693311] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.693416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.693512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.693706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.693795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.693933] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03ebea06-63b5-4bd8-b50a-443663efbb16 already deleted. [ 606.694135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03ebea06-63b5-4bd8-b50a-443663efbb16" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.028123] env[65446]: INFO networking_nsxv3.common.synchronization [req-b9932416-9142-4c70-9a83-bb5735413d35 req-8c43b00e-f678-4e7c-8796-2baaa36f2cdf service nova] Enqueued Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_rules [ 607.028123] env[65446]: INFO networking_nsxv3.common.synchronization [req-b9932416-9142-4c70-9a83-bb5735413d35 req-8c43b00e-f678-4e7c-8796-2baaa36f2cdf service nova] Enqueued Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_members [ 607.028123] env[65446]: INFO networking_nsxv3.common.synchronization [req-b9932416-9142-4c70-9a83-bb5735413d35 req-8c43b00e-f678-4e7c-8796-2baaa36f2cdf service nova] Enqueued Resource ID: 16cb0ed0-2606-4548-ba71-fd360978a69a with Priority: HIGHEST for action port [ 607.028123] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_rules [ 607.028629] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_members [ 607.028999] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16cb0ed0-2606-4548-ba71-fd360978a69a with Priority: HIGHEST for action port [ 607.029473] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.029759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.029917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.030324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.030511] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.033196] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.033196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.033196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.033196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.033196] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.033196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.033196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.033196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.033196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.033196] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.034719] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-16cb0ed0-2606-4548-ba71-fd360978a69a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.034996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.035203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.035502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.035776] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cb0ed0-2606-4548-ba71-fd360978a69a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.050314] env[65446]: INFO networking_nsxv3.common.synchronization [None req-37fe015d-e503-44d8-a028-87d3a324d46b tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 607.050757] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 607.052019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.052254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.052254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.052462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.052569] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.157438] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.157866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.157866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.158026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.158152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.158266] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be created. [ 607.171599] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d7339316-e495-4279-8df7-4d9c3806c45a tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 607.172201] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 607.172593] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.172775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.185715] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.185866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.185932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.186511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.186511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.196867] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: UNINITIALIZED for 2s [ 607.538269] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.538414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.538616] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.539551] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16cb0ed0-2606-4548-ba71-fd360978a69a with status ACTIVE [ 607.539751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.539864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.539928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.540146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.540236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.540452] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.540567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.540567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.540732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.540839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.540984] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.541083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.542292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.542604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.542604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.542699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16cb0ed0-2606-4548-ba71-fd360978a69a is going to be updated. [ 607.567695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.569047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.569047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.569047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.569047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.569047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16cb0ed0-2606-4548-ba71-fd360978a69a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.579604] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.579735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.580300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.580300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.580300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.580300] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 already deleted. [ 607.580300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.580517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.580627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.580730] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.662210] env[65446]: INFO networking_nsxv3.common.synchronization [req-aa80795e-f30f-4275-9bf8-224eb5bf5705 req-b480fb70-1f9f-41d4-8422-706838ec1436 tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 607.664604] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 607.664961] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.665110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.665177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.665466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.665629] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.665732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.665795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.665939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.666041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.666137] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.045086] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.045369] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.045537] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.045927] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.046281] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.046515] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.046685] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.046969] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.047230] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.047463] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.047633] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.047795] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.047924] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.048080] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.048235] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.048421] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.050138] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.070934] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.071056] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.071194] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.071378] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.071757] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-62da0239-5860-419a-bf9e-2e5941eee6f4 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.071944] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.072099] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.072516] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.072659] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62da0239-5860-419a-bf9e-2e5941eee6f4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.102517] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.102788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.102788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.102939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.103041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.103135] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 already deleted. [ 608.103214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.168156] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.168516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.168516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.168668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.168726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.168929] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.169049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.169108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.169260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.169335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.169414] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 already deleted. [ 608.169491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.552479] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.552673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.552762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.553035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.553157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.553267] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 is going to be created. [ 608.577591] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.577591] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 62da0239-5860-419a-bf9e-2e5941eee6f4 not found, creating... [ 608.577591] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.577591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.578095] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.578095] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.578095] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.578253] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.579140] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.579347] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 62da0239-5860-419a-bf9e-2e5941eee6f4 is going to be created. [ 608.581413] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.581413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.581413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.581800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.581957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.596427] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 in Status: UNINITIALIZED for 2s [ 608.606763] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.607014] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.607148] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.607971] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.607971] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.608206] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.209159] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 609.209503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.209603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.210121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.210229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.210298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.210386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.210503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.210586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.212039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.212039] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.353612] env[65446]: INFO networking_nsxv3.common.synchronization [req-aa80795e-f30f-4275-9bf8-224eb5bf5705 req-21452935-62e3-417d-ae0c-8f650c1c5641 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 609.353895] env[65446]: INFO networking_nsxv3.common.synchronization [req-aa80795e-f30f-4275-9bf8-224eb5bf5705 req-21452935-62e3-417d-ae0c-8f650c1c5641 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 609.354332] env[65446]: INFO networking_nsxv3.common.synchronization [req-aa80795e-f30f-4275-9bf8-224eb5bf5705 req-21452935-62e3-417d-ae0c-8f650c1c5641 service nova] Enqueued Resource ID: 62da0239-5860-419a-bf9e-2e5941eee6f4 with Priority: HIGHEST for action port [ 609.355077] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 609.355322] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 609.355490] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62da0239-5860-419a-bf9e-2e5941eee6f4 with Priority: HIGHEST for action port [ 609.355872] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.356029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.356113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.356520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.356601] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.357808] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.357975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.358083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.358314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.358532] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.359515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.359604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.359888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.360063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.360228] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.361420] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-62da0239-5860-419a-bf9e-2e5941eee6f4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.361605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.361699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.362008] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.362161] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62da0239-5860-419a-bf9e-2e5941eee6f4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.714463] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.715140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.715140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.715140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.715140] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.715387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.715387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.715446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.715550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.715666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.715784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.715880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.715941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.716098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.716236] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.716421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.716421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.716578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.716696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.716696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.716779] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.739428] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e7ddba50-5642-479c-805f-d9da51169a10 None None] Enqueued Resource ID: 6c3d599c-038c-4843-a4a3-a7493e41265d with Priority: HIGHEST for action port [ 609.739856] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3d599c-038c-4843-a4a3-a7493e41265d with Priority: HIGHEST for action port [ 609.740853] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c3d599c-038c-4843-a4a3-a7493e41265d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.740981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c3d599c-038c-4843-a4a3-a7493e41265d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.741080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c3d599c-038c-4843-a4a3-a7493e41265d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.742972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c3d599c-038c-4843-a4a3-a7493e41265d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.743087] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c3d599c-038c-4843-a4a3-a7493e41265d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.864289] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.866016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.866016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.866377] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62da0239-5860-419a-bf9e-2e5941eee6f4 with status ACTIVE [ 609.866710] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.866858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.866927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.867131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.867220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.867401] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.867494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.867567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.867931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.868022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.868210] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.868307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.868368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.868505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.868578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.868814] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62da0239-5860-419a-bf9e-2e5941eee6f4 is going to be updated. [ 609.892898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.892898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.892898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.893113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.893188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.893678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62da0239-5860-419a-bf9e-2e5941eee6f4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.220764] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b40223d-d70d-4f9e-8923-817eac1b52f3: rpc.has_security_group_logging(os_id): False [ 610.234565] env[65446]: INFO networking_nsxv3.common.synchronization [req-c2a08048-8cdb-4201-ba21-292668bab42a req-0e5043cd-fc7b-4722-93b6-1b6c469de967 tempest-ServersTestManualDisk-1783414972 tempest-ServersTestManualDisk-1783414972-project-member] Enqueued Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_members [ 610.235290] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_members [ 610.235608] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.235731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.235795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.236178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.236398] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.237016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.237016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.237166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.237295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.237414] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.242833] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.242833] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.242833] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.242833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.243719] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.243719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.243719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.243719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.243719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.243719] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be created. [ 610.246318] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c3d599c-038c-4843-a4a3-a7493e41265d [ 610.247466] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.248232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.248232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.248394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.248484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.248580] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c3d599c-038c-4843-a4a3-a7493e41265d already deleted. [ 610.248680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c3d599c-038c-4843-a4a3-a7493e41265d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.317818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.317981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.318422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.318422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.318523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.334988] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: IN_PROGRESS for 2s [ 610.369976] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.614564] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 in Status: SUCCESS [ 610.614806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.615033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.615374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.615590] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.615714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.615807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.615942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.616041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.616122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.616218] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.620763] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.620955] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-52" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.621080] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-52" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.622989] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-52" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.623468] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.623687] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.623893] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.624063] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.624252] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.624602] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.624602] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.624749] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.624916] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.625091] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.625226] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.625465] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.651264] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.651492] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.651733] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.651816] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-52" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.652206] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-4e6141cb-d907-4d1d-90f9-5c782f829be5 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.652310] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.652427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.652740] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.652867] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e6141cb-d907-4d1d-90f9-5c782f829be5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.740264] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.740459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.740504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.740810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.741352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.741352] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.741467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.741544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.742290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.742290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.742290] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 already deleted. [ 610.742290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.870832] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.871039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.871112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.871343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.871429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.871530] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be created. [ 610.898335] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.898504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.898585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.898825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.899058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.912918] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: UNINITIALIZED for 2s [ 611.128839] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.128946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.129053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.129277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.129451] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.129548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.129610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.129900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.129900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.130130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.130130] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.130204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.130431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.130431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.130539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.130614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.130679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.130799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.130863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.130942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.131075] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.155589] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.155799] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.155917] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.156271] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.156420] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.156572] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 4e6141cb-d907-4d1d-90f9-5c782f829be5 not found, creating... [ 611.156823] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.156976] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.157098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.157316] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.157447] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.157726] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.157873] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.157983] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.158212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.158399] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.158478] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 4e6141cb-d907-4d1d-90f9-5c782f829be5 is going to be created. [ 611.182307] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.182307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.182307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.182307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.182307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.182307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.634397] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab80b7a2-bff1-489c-be23-2853e30fe3b2: rpc.has_security_group_logging(os_id): False [ 611.657168] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.657168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.657168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.657168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.657168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.657168] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.657468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.657468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.657468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.657552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.658516] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.658516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.658516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.658516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.658516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.658516] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.658516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.658516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.664401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.664401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.664401] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 is going to be created. [ 611.731725] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.731903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.731965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.732155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.732354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.749643] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 in Status: IN_PROGRESS for 2s [ 611.984122] env[65446]: INFO networking_nsxv3.common.synchronization [req-c2a08048-8cdb-4201-ba21-292668bab42a req-6ea2e7ad-c632-4ccc-9c88-5d7c62fb6647 service nova] Enqueued Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_rules [ 611.984122] env[65446]: INFO networking_nsxv3.common.synchronization [req-c2a08048-8cdb-4201-ba21-292668bab42a req-6ea2e7ad-c632-4ccc-9c88-5d7c62fb6647 service nova] Enqueued Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_members [ 611.984122] env[65446]: INFO networking_nsxv3.common.synchronization [req-c2a08048-8cdb-4201-ba21-292668bab42a req-6ea2e7ad-c632-4ccc-9c88-5d7c62fb6647 service nova] Enqueued Resource ID: 4e6141cb-d907-4d1d-90f9-5c782f829be5 with Priority: HIGHEST for action port [ 611.984804] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_rules [ 611.985122] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_members [ 611.985331] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6141cb-d907-4d1d-90f9-5c782f829be5 with Priority: HIGHEST for action port [ 611.988544] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.988544] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.988544] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.988544] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.988544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.989695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.989756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.989817] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.990878] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e6141cb-d907-4d1d-90f9-5c782f829be5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.991032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.991099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.993182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.993182] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e6141cb-d907-4d1d-90f9-5c782f829be5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.357985] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 612.358249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.494916] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e6141cb-d907-4d1d-90f9-5c782f829be5 with status ACTIVE [ 612.495381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.496832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.497070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.497409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.497604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.498229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.499242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.499242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.499242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.499242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.499242] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.499242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.499680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.499998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.500215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.500419] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e6141cb-d907-4d1d-90f9-5c782f829be5 is going to be updated. [ 612.503663] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.503663] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.503663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.527579] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.527737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.527807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.528039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.528174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.528343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e6141cb-d907-4d1d-90f9-5c782f829be5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.549055] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-9c30c842-6e0a-45e2-8480-d886cd9bb18a tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 612.551564] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 612.552331] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.552556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.553016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.553016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.553113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.553178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.553211] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.553343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.553421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.553513] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.600681] env[65446]: INFO networking_nsxv3.common.synchronization [None req-a403a1e7-4b19-4d7a-969e-b8ca3050af5a None None] Enqueued Resource ID: 17bc2a55-61d8-4d6a-97c7-20a29df8023a with Priority: HIGHEST for action port [ 612.600681] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17bc2a55-61d8-4d6a-97c7-20a29df8023a with Priority: HIGHEST for action port [ 612.600851] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-17bc2a55-61d8-4d6a-97c7-20a29df8023a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.600851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17bc2a55-61d8-4d6a-97c7-20a29df8023a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.600965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17bc2a55-61d8-4d6a-97c7-20a29df8023a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.603477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17bc2a55-61d8-4d6a-97c7-20a29df8023a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.603477] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17bc2a55-61d8-4d6a-97c7-20a29df8023a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.926565] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 612.927131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.927394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.928297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.928824] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.930135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.930215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.931075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.931075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.931075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.931075] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.003845] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.058657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.058861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.058957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.059222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.059348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.059573] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.059714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.059809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.060413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.060538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.060652] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 already deleted. [ 613.060774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.065959] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-db048ba2-fd49-46b2-ab09-0d60c31ef196 tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 613.065959] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 613.066473] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.066473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.066983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.066983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.067067] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.067344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.067432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.067625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.067716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.067811] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.107772] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17bc2a55-61d8-4d6a-97c7-20a29df8023a [ 613.107950] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.108100] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.108171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.108391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.109152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.109152] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17bc2a55-61d8-4d6a-97c7-20a29df8023a already deleted. [ 613.109152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17bc2a55-61d8-4d6a-97c7-20a29df8023a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.436030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.436030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.436030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.436030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.436030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.436858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.436858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.436858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.436858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.436858] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.508097] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.508280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.508353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.508594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.508693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.509050] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 is going to be created. [ 613.542523] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.542760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.542760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.543293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.543293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.550960] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-35c6e799-403d-44d1-9be8-1103d94458ae tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 613.550960] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 613.550960] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.551170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.554690] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 in Status: UNINITIALIZED for 2s [ 613.574642] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.574642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.574642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.574642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.574642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.574962] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.574962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.574962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.575286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.575286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.575377] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 already deleted. [ 613.575485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.575702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.575862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.580252] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.580252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.580252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.580252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.580252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.580252] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.766423] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 in Status: SUCCESS [ 613.768562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.939903] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184: rpc.has_security_group_logging(os_id): False [ 613.963805] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.964032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.964319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.964686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.964779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.965490] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.965490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.965490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.966854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.966919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.967236] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.967391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.967587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.967727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.968368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.968368] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.968368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.968597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.968597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.968803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.968869] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be created. [ 613.975758] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.976272] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.976661] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.977250] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.977762] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.978037] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.978231] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.978591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.978819] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.979255] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.979314] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.979476] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.979647] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.979825] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.979995] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.980222] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.003563] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.003808] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.003865] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.004052] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.004510] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-d01a7ceb-3e2f-458f-bda9-53cf46495c31 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.004705] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.004839] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.005312] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.005669] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d01a7ceb-3e2f-458f-bda9-53cf46495c31',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.059326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.059517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.059591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.059851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.060074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.079711] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.079913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.079979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.080194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.080291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.080500] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.080593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.080708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.080816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.080910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.080983] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 already deleted. [ 614.081061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.081944] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 614.191765] env[65446]: INFO networking_nsxv3.common.synchronization [req-79e0974b-9506-4b20-a4fa-aa9c2fed3b5d req-62b50bac-fadc-4d6b-932e-d2ecbf14fb2d tempest-SecurityGroupRulesTestJSON-1365411131 tempest-SecurityGroupRulesTestJSON-1365411131-project-member] Enqueued Resource ID: 2705bbdb-00be-4b89-8978-448c64042a60 with Priority: HIGHEST for action security_group_rules [ 614.192467] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2705bbdb-00be-4b89-8978-448c64042a60 with Priority: HIGHEST for action security_group_rules [ 614.196216] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2705bbdb-00be-4b89-8978-448c64042a60 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.196216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2705bbdb-00be-4b89-8978-448c64042a60" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.196216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2705bbdb-00be-4b89-8978-448c64042a60" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.196216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2705bbdb-00be-4b89-8978-448c64042a60" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.196216] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2705bbdb-00be-4b89-8978-448c64042a60',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.509237] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.509552] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.509771] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.510226] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.510423] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.510593] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port d01a7ceb-3e2f-458f-bda9-53cf46495c31 not found, creating... [ 614.510878] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.511156] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.511353] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.511702] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.512038] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.512783] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.512905] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.513060] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.513408] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.513585] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.513740] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: d01a7ceb-3e2f-458f-bda9-53cf46495c31 is going to be created. [ 614.556185] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.556492] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.556656] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.556988] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.557291] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.557561] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.719043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.719259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.719305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.719628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.719781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.719781] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2705bbdb-00be-4b89-8978-448c64042a60 already deleted. [ 614.719889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2705bbdb-00be-4b89-8978-448c64042a60" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.992960] env[65446]: INFO networking_nsxv3.common.synchronization [req-03212795-9098-4ad7-80e0-3d2a79909506 req-d7c52d34-8406-4724-b954-27c25575e4d5 tempest-VolumesAssistedSnapshotsTest-973014014 tempest-VolumesAssistedSnapshotsTest-973014014-project-member] Enqueued Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_members [ 614.993528] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_members [ 614.993860] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.993982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.994241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.994587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.994779] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.994911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.994993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.995184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.995317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.995469] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.288461] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-f07310a0-4e19-4ee7-84f7-7aba304b4944 service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 615.288694] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-f07310a0-4e19-4ee7-84f7-7aba304b4944 service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 615.288940] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-f07310a0-4e19-4ee7-84f7-7aba304b4944 service nova] Enqueued Resource ID: d01a7ceb-3e2f-458f-bda9-53cf46495c31 with Priority: HIGHEST for action port [ 615.290609] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 615.290609] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 615.290609] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d01a7ceb-3e2f-458f-bda9-53cf46495c31 with Priority: HIGHEST for action port [ 615.290932] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.291174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.291342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.291777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.291971] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.294073] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.294311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.294446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.294867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.295193] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.295415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.296190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.296190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.296190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.296352] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.297621] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d01a7ceb-3e2f-458f-bda9-53cf46495c31 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.298483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.298628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.298927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.299334] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d01a7ceb-3e2f-458f-bda9-53cf46495c31',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.499051] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.499238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.499238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.500105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.500105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.500105] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.500105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.500105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.501087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.501087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.501087] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 already deleted. [ 615.501087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.567091] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 in Status: SUCCESS [ 615.567329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.567611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.567955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.567955] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.568096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.568096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.568237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.568315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.568398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.568486] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.640784] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.641277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-872" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.641277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-872" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.641429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-872" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.641665] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.641817] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.641929] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.642154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.642313] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.642535] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.642641] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.642747] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.642848] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.642948] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.643352] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.643352] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.665357] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.665709] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.665709] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.665796] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-872" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.666149] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-4320e07f-1c31-464f-8944-f3ae833aaf0d taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.666329] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.666460] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.666797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.666942] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4320e07f-1c31-464f-8944-f3ae833aaf0d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.801503] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.801652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.801837] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.805598] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d01a7ceb-3e2f-458f-bda9-53cf46495c31 with status ACTIVE [ 615.805598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.805598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.805598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.805598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.806632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.806632] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d01a7ceb-3e2f-458f-bda9-53cf46495c31 is going to be updated. [ 615.831274] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.831545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.831545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.832012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.832108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.832272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d01a7ceb-3e2f-458f-bda9-53cf46495c31" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.071355] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.098253] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 616.098498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.169680] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.169962] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.170420] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.170740] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.171932] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.171932] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 4320e07f-1c31-464f-8944-f3ae833aaf0d not found, creating... [ 616.171932] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.171932] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.171932] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.171932] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.172382] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.172382] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.172548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.172688] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.173224] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.173963] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.173963] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 4320e07f-1c31-464f-8944-f3ae833aaf0d is going to be created. [ 616.198474] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.199742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.199742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.199742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.199742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.199742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.307969] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.574739] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1f4fde9-b384-4390-8aee-ba47e4cd1304: rpc.has_security_group_logging(os_id): False [ 616.603587] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.603826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.603826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.604068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.604173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.604448] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.604550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.604612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.604771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.604853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.605022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 is going to be created. [ 616.678250] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.678460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.678460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.678660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.678836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.696903] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 in Status: IN_PROGRESS for 2s [ 616.811296] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.811595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.811595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.811811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.811895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.812021] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be created. [ 616.850665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.850901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.850982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.851264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.851431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.869116] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: UNINITIALIZED for 2s [ 617.001507] env[65446]: INFO networking_nsxv3.common.synchronization [req-03212795-9098-4ad7-80e0-3d2a79909506 req-9f88e761-c7fb-445a-acd6-d150afdb67ef service nova] Enqueued Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_rules [ 617.001770] env[65446]: INFO networking_nsxv3.common.synchronization [req-03212795-9098-4ad7-80e0-3d2a79909506 req-9f88e761-c7fb-445a-acd6-d150afdb67ef service nova] Enqueued Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_members [ 617.001916] env[65446]: INFO networking_nsxv3.common.synchronization [req-03212795-9098-4ad7-80e0-3d2a79909506 req-9f88e761-c7fb-445a-acd6-d150afdb67ef service nova] Enqueued Resource ID: 4320e07f-1c31-464f-8944-f3ae833aaf0d with Priority: HIGHEST for action port [ 617.003474] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_rules [ 617.003474] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_members [ 617.003474] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320e07f-1c31-464f-8944-f3ae833aaf0d with Priority: HIGHEST for action port [ 617.003474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.003474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.003824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.003909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.004095] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.005450] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.005450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.005450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.005706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.005974] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.006093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.006093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.006259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.006349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.006453] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.007423] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4320e07f-1c31-464f-8944-f3ae833aaf0d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.007608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.007608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.007766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.007834] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4320e07f-1c31-464f-8944-f3ae833aaf0d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.433176] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.433505] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-202" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.433505] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-202" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.434691] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-202" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.434691] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.434691] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.434691] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.434939] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.435081] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.435298] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.435449] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.435522] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.435598] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.435699] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.435801] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.435950] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.461300] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.461442] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.461512] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.462110] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-202" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.462110] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-61c7ffd7-426e-46c8-93be-78507bda79dc taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.462357] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.462357] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.462689] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.462846] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61c7ffd7-426e-46c8-93be-78507bda79dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.511082] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4320e07f-1c31-464f-8944-f3ae833aaf0d with status ACTIVE [ 617.511082] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.511270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.511270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.512092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.512235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.513055] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.513055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.513055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.513055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.513055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.513327] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.513327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.513327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.513442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.513488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.513549] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4320e07f-1c31-464f-8944-f3ae833aaf0d is going to be updated. [ 617.515574] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.515647] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.515957] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.542475] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.542475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.542727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.542761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.543261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.543261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4320e07f-1c31-464f-8944-f3ae833aaf0d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.965385] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.965690] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.965988] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.966234] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.966435] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.966653] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 61c7ffd7-426e-46c8-93be-78507bda79dc not found, creating... [ 617.967031] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.967223] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.967358] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.967613] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.967784] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.968250] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.968436] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.968599] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.969173] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.969173] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.969327] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 61c7ffd7-426e-46c8-93be-78507bda79dc is going to be created. [ 617.991816] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.992180] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.992367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.992716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.993192] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.993377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.019299] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.358667] env[65446]: INFO networking_nsxv3.common.synchronization [None req-f37b3171-4b52-44c1-b9ae-692ef8b68276 None None] Enqueued Resource ID: aa507677-2470-4c1c-9df5-d8f44437acf8 with Priority: HIGHEST for action port [ 618.358913] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa507677-2470-4c1c-9df5-d8f44437acf8 with Priority: HIGHEST for action port [ 618.359688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa507677-2470-4c1c-9df5-d8f44437acf8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.359892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa507677-2470-4c1c-9df5-d8f44437acf8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.360016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa507677-2470-4c1c-9df5-d8f44437acf8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.360783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa507677-2470-4c1c-9df5-d8f44437acf8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.360921] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa507677-2470-4c1c-9df5-d8f44437acf8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.523689] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.524093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.524093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.524275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.524481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.524627] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 is going to be created. [ 618.558275] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.558986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.558986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.558986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.558986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.568312] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 in Status: UNINITIALIZED for 2s [ 618.711414] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 in Status: SUCCESS [ 618.711637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.728822] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-cc33fff9-a3ce-4182-8546-831f4ec2021a service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 618.728998] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-cc33fff9-a3ce-4182-8546-831f4ec2021a service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 618.729148] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-cc33fff9-a3ce-4182-8546-831f4ec2021a service nova] Enqueued Resource ID: 61c7ffd7-426e-46c8-93be-78507bda79dc with Priority: HIGHEST for action port [ 618.729677] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 618.729810] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 618.729909] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c7ffd7-426e-46c8-93be-78507bda79dc with Priority: HIGHEST for action port [ 618.730190] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.730293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.730477] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.730561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.730743] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-61c7ffd7-426e-46c8-93be-78507bda79dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.730846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.730909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.731122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.731201] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61c7ffd7-426e-46c8-93be-78507bda79dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.864234] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa507677-2470-4c1c-9df5-d8f44437acf8 [ 618.864234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.864595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.864595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.865373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.865373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.865373] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa507677-2470-4c1c-9df5-d8f44437acf8 already deleted. [ 618.865373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa507677-2470-4c1c-9df5-d8f44437acf8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.884593] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 618.884842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.885018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.885246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.885459] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.885579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.885643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.885793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.885876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.885958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.886075] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.886898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.887240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.887697] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.887941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.887941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.888232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.888427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.888612] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.236501] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61c7ffd7-426e-46c8-93be-78507bda79dc with status ACTIVE [ 619.236501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.236501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.236501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.236501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.236756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.236942] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.237061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.237061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.237231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.237287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.237634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.237634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.237634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.237762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.237797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.237899] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61c7ffd7-426e-46c8-93be-78507bda79dc is going to be updated. [ 619.269941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.270107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.270169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.270379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.270498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.270679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61c7ffd7-426e-46c8-93be-78507bda79dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.391434] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.391575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.391781] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.529614] env[65446]: INFO networking_nsxv3.common.synchronization [req-e53107f2-fc60-47b8-8ce5-a5f985b06051 req-1d79d21a-8f55-4f90-acac-bf603a0964a6 tempest-ServerExternalEventsTest-1427882636 tempest-ServerExternalEventsTest-1427882636-project-member] Enqueued Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_members [ 619.531810] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_members [ 619.532651] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.532794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.532957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.533405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.533579] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.533693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.533761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.533999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.534128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.534495] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.787060] env[65446]: INFO networking_nsxv3.common.synchronization [req-6d0150f6-021a-44d4-a796-d2cfc73744ef req-7c5dc13d-8d34-4b5a-93fa-7c4f6987109b tempest-DeleteServersAdminTestJSON-1483781078 tempest-DeleteServersAdminTestJSON-1483781078-project-admin] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 619.788188] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 619.788781] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.789011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.789133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.789433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.790459] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.790833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.790956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.794449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.794667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.794759] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.894577] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.036977] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.037156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.037226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.037447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.037538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.037735] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.037837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.037907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.038070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.038146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.038238] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9add5c-c992-43ca-9245-5304b7194290 already deleted. [ 620.038323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.250664] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.250664] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.250664] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.250950] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.251204] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.251796] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.251796] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.251796] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.252155] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.252423] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.252570] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.252705] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.252836] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.252993] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.253101] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.253887] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.278414] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.278414] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.278414] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.278414] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-517" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.278676] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-4e6638c4-af8e-4330-aa40-3162549fcd6a taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.278676] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.278917] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.279791] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.279929] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e6638c4-af8e-4330-aa40-3162549fcd6a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.297314] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.298120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.298951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.299224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.299710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.300473] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.300607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.300661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.300871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.300953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.301076] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be updated. [ 620.353908] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.353908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.353908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.354189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.354316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.365279] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: IN_PROGRESS for 2s [ 620.397146] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.397399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.397513] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.397765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.397910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.398072] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 620.440662] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.440863] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.440989] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.441325] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.441591] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.441751] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.441870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.442088] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.442231] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.442435] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.442547] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.442655] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.442754] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.442857] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.442964] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.443098] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.454107] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.454353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.454353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.454543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.454699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.466579] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 620.467559] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.467717] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.467852] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.468031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.468343] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-a9c11c58-5876-45d7-81c1-218be1362162 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.468516] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.468632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.468950] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.469090] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9c11c58-5876-45d7-81c1-218be1362162',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.578887] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 in Status: SUCCESS [ 620.579224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.579335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.579550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.579735] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.579853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.579940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.580083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.580165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.580253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.580345] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.627961] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d3beb0d0-c6cd-4a9d-b96f-bad2bb1693cd None None] Enqueued Resource ID: 2d68f25d-bc75-4b6d-9596-62d131b7633b with Priority: HIGHEST for action port [ 620.628572] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d68f25d-bc75-4b6d-9596-62d131b7633b with Priority: HIGHEST for action port [ 620.628875] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d68f25d-bc75-4b6d-9596-62d131b7633b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.629026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d68f25d-bc75-4b6d-9596-62d131b7633b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.629091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d68f25d-bc75-4b6d-9596-62d131b7633b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.629362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d68f25d-bc75-4b6d-9596-62d131b7633b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.629496] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d68f25d-bc75-4b6d-9596-62d131b7633b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.783198] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.783458] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.783583] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.783869] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.784028] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.784181] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 4e6638c4-af8e-4330-aa40-3162549fcd6a not found, creating... [ 620.784558] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.784728] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.784876] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.785138] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.785276] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.785808] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.786065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.786238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.786553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.786742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.786938] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 4e6638c4-af8e-4330-aa40-3162549fcd6a is going to be created. [ 620.808846] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.809141] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.809252] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.809521] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.809749] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.809975] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.971296] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.971553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.971643] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.971943] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.972105] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.972270] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port a9c11c58-5876-45d7-81c1-218be1362162 not found, creating... [ 620.972529] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.972687] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.972802] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.973033] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.973172] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.973450] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.973626] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.973741] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.973946] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.974431] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.974672] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: a9c11c58-5876-45d7-81c1-218be1362162 is going to be created. [ 621.010936] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.011199] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.011331] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.011604] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.011824] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.012052] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.082747] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.131639] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d68f25d-bc75-4b6d-9596-62d131b7633b [ 621.131897] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.132105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.132204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.132515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.132636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.132761] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d68f25d-bc75-4b6d-9596-62d131b7633b already deleted. [ 621.132868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d68f25d-bc75-4b6d-9596-62d131b7633b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.533788] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-61ded73e-2bee-44fc-96d6-421a73c0d33b service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 621.533966] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-61ded73e-2bee-44fc-96d6-421a73c0d33b service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 621.534133] env[65446]: INFO networking_nsxv3.common.synchronization [req-61308c18-852d-40b8-a3e9-94191c78029f req-61ded73e-2bee-44fc-96d6-421a73c0d33b service nova] Enqueued Resource ID: 4e6638c4-af8e-4330-aa40-3162549fcd6a with Priority: HIGHEST for action port [ 621.534987] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 621.534987] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 621.534987] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6638c4-af8e-4330-aa40-3162549fcd6a with Priority: HIGHEST for action port [ 621.535293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.535377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.535581] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.535665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.535840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e6638c4-af8e-4330-aa40-3162549fcd6a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.535985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.536084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.540024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.540024] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e6638c4-af8e-4330-aa40-3162549fcd6a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.584786] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ae2085b-a069-4f37-b210-ebb8cf045349: rpc.has_security_group_logging(os_id): False [ 621.608292] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.608498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.608622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.608849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.608983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.609323] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.609435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.609494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.609649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.609728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.609833] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 is going to be created. [ 621.698723] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.698869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.698994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.699168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.699356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.710612] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 in Status: IN_PROGRESS for 2s [ 621.729715] env[65446]: INFO networking_nsxv3.common.synchronization [req-e53107f2-fc60-47b8-8ce5-a5f985b06051 req-852b52e1-acc2-4946-83a0-5bdd1da90748 service nova] Enqueued Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_rules [ 621.729895] env[65446]: INFO networking_nsxv3.common.synchronization [req-e53107f2-fc60-47b8-8ce5-a5f985b06051 req-852b52e1-acc2-4946-83a0-5bdd1da90748 service nova] Enqueued Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_members [ 621.730034] env[65446]: INFO networking_nsxv3.common.synchronization [req-e53107f2-fc60-47b8-8ce5-a5f985b06051 req-852b52e1-acc2-4946-83a0-5bdd1da90748 service nova] Enqueued Resource ID: a9c11c58-5876-45d7-81c1-218be1362162 with Priority: HIGHEST for action port [ 621.730271] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_rules [ 621.730401] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_members [ 621.730498] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c11c58-5876-45d7-81c1-218be1362162 with Priority: HIGHEST for action port [ 621.731147] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.731636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.731723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.732055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.732150] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.733313] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.734198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.734198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.734198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.734198] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.734198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.734198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.734198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.734559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.734559] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.736176] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9c11c58-5876-45d7-81c1-218be1362162 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.736291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.736583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.737914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.738036] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9c11c58-5876-45d7-81c1-218be1362162',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.040801] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e6638c4-af8e-4330-aa40-3162549fcd6a with status ACTIVE [ 622.040801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.040801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.040801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.040801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.040801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.040801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.040801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.040801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.041692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.042026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.043074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.043074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.043074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.043074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.043074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.043074] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e6638c4-af8e-4330-aa40-3162549fcd6a is going to be updated. [ 622.068274] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.068423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.068487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.068699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.068857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.068980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e6638c4-af8e-4330-aa40-3162549fcd6a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.135208] env[65446]: INFO networking_nsxv3.common.synchronization [req-3e2ad57d-8231-40f4-a136-14ffc6a66439 req-7091ac2a-e627-41c3-b75c-5682b80a839f tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 622.135823] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 622.136130] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.136246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.136321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.136558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.136710] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.136801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.136860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.137552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.137674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.137773] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.241966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.241966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.241966] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.241966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9c11c58-5876-45d7-81c1-218be1362162 with status ACTIVE [ 622.241966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.241966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.241966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.241966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.241966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.241966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.241966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.242813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.242813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.242813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.242813] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.242813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.242813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.242813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.242813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.244037] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9c11c58-5876-45d7-81c1-218be1362162 is going to be updated. [ 622.270873] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.271097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.271228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.271855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.271855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.271855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9c11c58-5876-45d7-81c1-218be1362162" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.376864] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: SUCCESS [ 622.378209] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 deletion is rescheduled due to dependency. [ 622.378209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.418017] env[65446]: INFO networking_nsxv3.common.synchronization [req-d39b7776-9ce7-4baa-931c-0b7904f1f340 req-e8174d03-0ff5-4da5-82b7-21210f92631e tempest-FloatingIPsAssociationNegativeTestJSON-1351588854 tempest-FloatingIPsAssociationNegativeTestJSON-1351588854-project-member] Enqueued Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_members [ 622.418017] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_members [ 622.418017] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.418017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.418017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.418651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.419090] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.419328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.419477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.419729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.419961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.420763] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.478877] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 622.479128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.479330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.479596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.480188] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.480188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.480188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.480188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.480463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.480463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.480569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.480640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.480728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.480879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.481076] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.481178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.481239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.481382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.481474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.481578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.481678] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.482571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.482927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.482927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.483052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.483052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.483184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.483259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.483346] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.639982] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.640273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.640273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.640458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.640548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.640750] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.640849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.640910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.641076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.641153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.641238] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 already deleted. [ 622.641320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.700624] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.700624] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.700624] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.700909] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.701162] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.701347] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.701534] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.701899] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.702154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.702486] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.702685] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.702879] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.703072] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.703270] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.703458] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.703696] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.731917] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.731917] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.731917] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.731917] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.731917] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-78d98ff1-b32c-40df-8260-a6cb8716c782 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.731917] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.731917] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.731917] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.731917] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d98ff1-b32c-40df-8260-a6cb8716c782',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.747741] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.913689] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.913926] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-863" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.914072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-863" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.914437] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-863" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.914760] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.914949] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.914949] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.915193] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.915331] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.915660] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.915775] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.915882] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.915983] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.916098] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.916197] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.916320] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.922942] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.923091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.923162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.923343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.923432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.923613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.923709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.923770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.923910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.923981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.924074] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 already deleted. [ 622.924154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.935611] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.935785] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.935935] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.936175] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-863" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.936570] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-597d06fc-ed94-4cb4-b93a-a25e81e8174f taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.936769] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.936893] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.937210] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.937354] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('597d06fc-ed94-4cb4-b93a-a25e81e8174f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.984740] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fba5fede-4e1d-4734-bb87-51495f4aff23: rpc.has_security_group_logging(os_id): False [ 622.986323] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.018486] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.018486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.018486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.018486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.018977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.018977] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.018977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.018977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.019150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.019150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.019306] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.019405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.019468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.019608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.019682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.019923] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.020034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.020034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.020158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.020203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.020282] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be created. [ 623.098836] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.098991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.099073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.099308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.099509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.113354] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 623.233702] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.233979] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.234121] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.234584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.234960] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.234960] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 78d98ff1-b32c-40df-8260-a6cb8716c782 not found, creating... [ 623.235262] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.235511] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.235674] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.236161] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.236161] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.236395] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.236833] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.236833] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.236930] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.237082] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.237278] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 78d98ff1-b32c-40df-8260-a6cb8716c782 is going to be created. [ 623.249318] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.249605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.249605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.249692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.249806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.249915] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9add5c-c992-43ca-9245-5304b7194290 is going to be created. [ 623.276903] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.276903] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.276903] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.277291] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.277435] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.278047] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.292700] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.292846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.292921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.293162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.293320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.313147] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9add5c-c992-43ca-9245-5304b7194290 in Status: UNINITIALIZED for 2s [ 623.439727] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.439964] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.440084] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.440369] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.440519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.440693] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 597d06fc-ed94-4cb4-b93a-a25e81e8174f not found, creating... [ 623.440973] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.441152] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.441265] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.441499] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.441667] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.441958] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.442129] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.442244] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.442504] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.442641] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.442829] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 597d06fc-ed94-4cb4-b93a-a25e81e8174f is going to be created. [ 623.476086] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.476375] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.476548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.476930] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.477253] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.477560] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.488543] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.723655] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 in Status: SUCCESS [ 623.724056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.991178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.991178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.991178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.991679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.991679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.991752] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 624.010371] env[65446]: INFO networking_nsxv3.common.synchronization [req-3e2ad57d-8231-40f4-a136-14ffc6a66439 req-3b082942-bf56-4b49-83b7-6addd12a38c3 service nova] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 624.010590] env[65446]: INFO networking_nsxv3.common.synchronization [req-3e2ad57d-8231-40f4-a136-14ffc6a66439 req-3b082942-bf56-4b49-83b7-6addd12a38c3 service nova] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 624.010741] env[65446]: INFO networking_nsxv3.common.synchronization [req-3e2ad57d-8231-40f4-a136-14ffc6a66439 req-3b082942-bf56-4b49-83b7-6addd12a38c3 service nova] Enqueued Resource ID: 78d98ff1-b32c-40df-8260-a6cb8716c782 with Priority: HIGHEST for action port [ 624.011633] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 624.011851] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 624.011923] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d98ff1-b32c-40df-8260-a6cb8716c782 with Priority: HIGHEST for action port [ 624.012292] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.012584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.012584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.012806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.012882] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.015598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.015728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.015787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.016050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.016225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.016902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.016977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.017169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.017316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.017425] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.019173] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-78d98ff1-b32c-40df-8260-a6cb8716c782 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.019291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.019360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.019529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.019825] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d98ff1-b32c-40df-8260-a6cb8716c782',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.034302] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.034546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.034604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.035031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.035303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.050896] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 624.189310] env[65446]: INFO networking_nsxv3.common.synchronization [req-d39b7776-9ce7-4baa-931c-0b7904f1f340 req-427d7d40-59e7-40d7-817f-665ea9bcac63 service nova] Enqueued Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_rules [ 624.189485] env[65446]: INFO networking_nsxv3.common.synchronization [req-d39b7776-9ce7-4baa-931c-0b7904f1f340 req-427d7d40-59e7-40d7-817f-665ea9bcac63 service nova] Enqueued Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_members [ 624.189621] env[65446]: INFO networking_nsxv3.common.synchronization [req-d39b7776-9ce7-4baa-931c-0b7904f1f340 req-427d7d40-59e7-40d7-817f-665ea9bcac63 service nova] Enqueued Resource ID: 597d06fc-ed94-4cb4-b93a-a25e81e8174f with Priority: HIGHEST for action port [ 624.190399] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_rules [ 624.190542] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_members [ 624.190683] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597d06fc-ed94-4cb4-b93a-a25e81e8174f with Priority: HIGHEST for action port [ 624.191455] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.191599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.191683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.191949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.192054] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.193513] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.193632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.193783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.196640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.196640] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.196640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-597d06fc-ed94-4cb4-b93a-a25e81e8174f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.196640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.197168] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('597d06fc-ed94-4cb4-b93a-a25e81e8174f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.517178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.517178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.521250] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.524368] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78d98ff1-b32c-40df-8260-a6cb8716c782 with status ACTIVE [ 624.524865] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.525213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.525574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.528023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.528023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.528023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.528023] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78d98ff1-b32c-40df-8260-a6cb8716c782 is going to be updated. [ 624.558179] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.558179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.558179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.558179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.558179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.558179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78d98ff1-b32c-40df-8260-a6cb8716c782" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.694988] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.695189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.701747] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.703043] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 597d06fc-ed94-4cb4-b93a-a25e81e8174f with status ACTIVE [ 624.704042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.704042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.704042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.704250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.705653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.705653] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.705653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.705653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.705969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.705969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.706149] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.706751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.706751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.706751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.706751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.706932] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 597d06fc-ed94-4cb4-b93a-a25e81e8174f is going to be updated. [ 624.754607] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.754934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.754934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.755059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.755201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.755364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-597d06fc-ed94-4cb4-b93a-a25e81e8174f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.023813] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.159776] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 625.160443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.160700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.161028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.161137] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.212633] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.333026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9add5c-c992-43ca-9245-5304b7194290 in Status: SUCCESS [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.333026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.333026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.333026] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.527941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.527941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.527941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.527941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.527941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.527941] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be created. [ 625.556487] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.556669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.557443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.557779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.558062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.573106] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: UNINITIALIZED for 2s [ 625.665840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.665840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.717090] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.717090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.717090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.717090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.717090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.717090] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 is going to be created. [ 625.748051] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.748581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.748799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.749808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.749995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.761446] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 in Status: UNINITIALIZED for 2s [ 625.836691] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.836963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.836963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.837255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.837427] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.837549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.837769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.837769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.837977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.838524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.838696] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.838855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.838945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.839068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.839236] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.839332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.839400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.839540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.839662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.839733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.839916] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.061705] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 626.062103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.062234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.062468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.062681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.062817] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.062889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.063071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.063147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.063230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.063336] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.342204] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df9add5c-c992-43ca-9245-5304b7194290: rpc.has_security_group_logging(os_id): False [ 626.362761] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.362761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.362761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.362761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.362761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.362761] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.363236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.363236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.363236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.363236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.363620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.363620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.363620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.363620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.363766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.363910] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.363910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.364030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.364186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.364266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.364349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9add5c-c992-43ca-9245-5304b7194290 is going to be created. [ 626.434601] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.434806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.434889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.435078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.435542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.451326] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9add5c-c992-43ca-9245-5304b7194290 in Status: IN_PROGRESS for 2s [ 626.497389] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9f589a77-2256-4e7c-868c-e3ad49f8f124 None None] Enqueued Resource ID: dde5ecf1-a412-4a81-8b8b-0b82435fd168 with Priority: HIGHEST for action port [ 626.498032] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde5ecf1-a412-4a81-8b8b-0b82435fd168 with Priority: HIGHEST for action port [ 626.498475] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde5ecf1-a412-4a81-8b8b-0b82435fd168 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.498678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde5ecf1-a412-4a81-8b8b-0b82435fd168" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.498678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde5ecf1-a412-4a81-8b8b-0b82435fd168" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.501757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde5ecf1-a412-4a81-8b8b-0b82435fd168" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.501757] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde5ecf1-a412-4a81-8b8b-0b82435fd168',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.565428] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.565621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.565717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.566093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.566093] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.566240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.566240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.566480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.566480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.566610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.566739] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.566968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.566968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.567090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.567199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.567291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.567355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.567496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.567582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.567673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.567786] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.005294] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dde5ecf1-a412-4a81-8b8b-0b82435fd168 [ 627.005611] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.007197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.007197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.007197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.007197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.007197] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dde5ecf1-a412-4a81-8b8b-0b82435fd168 already deleted. [ 627.007197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde5ecf1-a412-4a81-8b8b-0b82435fd168" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.075143] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fba5fede-4e1d-4734-bb87-51495f4aff23: rpc.has_security_group_logging(os_id): False [ 627.097488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.098070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.098070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.098070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.098070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.098265] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.098265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.098265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.098398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.098473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.098650] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.098739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.100042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.100042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.100042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.100042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.100042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.100042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.100042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.100042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.100042] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 627.187364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.187529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.187572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.187876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.187989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.203262] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 627.583622] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 627.583881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.584090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.584341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.584601] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.585222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.585324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.585528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.585644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.585758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.586024] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.774015] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 in Status: SUCCESS [ 627.774389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.774720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.775485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.776521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.776521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.776521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.776521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.776737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.776737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.776822] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.088586] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.280447] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.280615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.280684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.280908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.281093] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.281194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.281247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.281400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.281483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.281606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.281711] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.281831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.281868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.283067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.283067] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.283067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.283067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.283067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.283067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.283067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.283067] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.483156] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9add5c-c992-43ca-9245-5304b7194290 in Status: SUCCESS [ 628.483156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.591095] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3905b26b-bddd-4c0d-8d21-44f2dd75c139: rpc.has_security_group_logging(os_id): False [ 628.617780] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.617780] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.617780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.618395] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be created. [ 628.702206] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.702375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.702601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.703259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.703259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.715909] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 628.787966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6: rpc.has_security_group_logging(os_id): False [ 628.809069] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.809867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.810139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.810489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.812018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.812018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.812018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.812018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.812018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.812018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.812018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.812018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.812018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.812620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.812877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.813245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.815690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.815690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.815690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.815690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.815690] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 is going to be created. [ 628.922238] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.924049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.924049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.924049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.924049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.936987] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 in Status: IN_PROGRESS for 2s [ 629.219210] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 629.219455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.219495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.220828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.221250] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.724841] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.725104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.725104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.725801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.726012] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.726782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.726782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.726782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.726782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.727214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.727214] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.856743] env[65446]: INFO networking_nsxv3.common.synchronization [None req-2e147444-ae3c-48f5-933a-1ae50da3521b None None] Enqueued Resource ID: 5bc55f83-f109-403c-a84e-d542c1cad567 with Priority: HIGHEST for action port [ 629.856743] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bc55f83-f109-403c-a84e-d542c1cad567 with Priority: HIGHEST for action port [ 629.856743] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bc55f83-f109-403c-a84e-d542c1cad567 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.856964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bc55f83-f109-403c-a84e-d542c1cad567" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.856964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bc55f83-f109-403c-a84e-d542c1cad567" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.860038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bc55f83-f109-403c-a84e-d542c1cad567" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.860204] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bc55f83-f109-403c-a84e-d542c1cad567',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.000541] env[65446]: INFO networking_nsxv3.common.synchronization [req-bbf7cd58-456f-4501-abf2-4b63c3cc63bc req-d73a1736-b83e-44c4-9717-98183594c520 tempest-ServersAdminNegativeTestJSON-1179735760 tempest-ServersAdminNegativeTestJSON-1179735760-project-member] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 630.000541] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 630.001189] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.001546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.005527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.005527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.005527] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.005527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.005527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.005527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.005527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.005527] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.236139] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.236621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.236621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.236621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.237224] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.237224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.237224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.237224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.237224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.237224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.237444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.237444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.237707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.237707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.237847] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.237984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.238392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.238392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.238392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.238392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.238533] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.368171] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bc55f83-f109-403c-a84e-d542c1cad567 [ 630.369568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.369568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.369568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.369568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.369568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.369568] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bc55f83-f109-403c-a84e-d542c1cad567 already deleted. [ 630.369568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bc55f83-f109-403c-a84e-d542c1cad567" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.495606] env[65446]: INFO networking_nsxv3.common.synchronization [None req-fc446334-8fb6-413b-b390-2cf1bd51ab6e tempest-ServersWithSpecificFlavorTestJSON-599263955 tempest-ServersWithSpecificFlavorTestJSON-599263955-project-member] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 630.495842] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 630.496440] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.496440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.496440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.496941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.496941] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.508271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.508395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.508558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.508805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.508946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.509199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.509355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.509517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.509715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.509840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.509977] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56ef744e-edae-484b-8821-4f332fd192db already deleted. [ 630.510202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.673037] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.673276] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.673276] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.673502] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.673799] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.674049] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.674175] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.674379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.674541] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.674771] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.674892] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.675008] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.675110] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.675229] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.675317] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.675477] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.695918] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.695995] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.696295] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.696399] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.696657] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.696972] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.696972] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.697277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.697429] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece21177-c97a-4b0c-a39e-f7e0f9fcea09',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.730629] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 630.730629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.741421] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fba5fede-4e1d-4734-bb87-51495f4aff23: rpc.has_security_group_logging(os_id): False [ 630.760990] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.761168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.761242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.761501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.761908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.762203] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.762408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.762408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.762800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.762800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.762993] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.763311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.763311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.763311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.763439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.763539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.763718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.763784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.763933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.764021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.765101] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 630.836613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.836762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.836826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.837118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.837279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.856136] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 630.953704] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 in Status: SUCCESS [ 630.953936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.018349] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.018564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.018704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.018857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.018983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.019051] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 already deleted. [ 631.019138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.051246] env[65446]: INFO networking_nsxv3.common.synchronization [None req-8b756c49-0d4b-4a49-ac82-dd56ea5d1609 tempest-ServersWithSpecificFlavorTestJSON-599263955 tempest-ServersWithSpecificFlavorTestJSON-599263955-project-member] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 631.051944] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 631.052245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.052564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.052667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.052887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.053012] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.203023] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.203023] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port ece21177-c97a-4b0c-a39e-f7e0f9fcea09 not found, creating... [ 631.203023] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.203023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.207145] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.207145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.207145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.207145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.207145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.207145] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: ece21177-c97a-4b0c-a39e-f7e0f9fcea09 is going to be created. [ 631.225544] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.225881] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.226062] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.226354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.226741] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.226854] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.301573] env[65446]: INFO networking_nsxv3.common.synchronization [req-47f5240d-61af-48e2-bf4e-9c8d6abf82ef req-de4249fb-59f8-4374-8dd9-8b1df1df16b3 tempest-InstanceActionsV221TestJSON-1825224203 tempest-InstanceActionsV221TestJSON-1825224203-project-member] Enqueued Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_members [ 631.302321] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGHEST for action security_group_members [ 631.302682] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.302818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.302884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.303155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.303512] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.303622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.303664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.303909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.304289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.304289] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.577038] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.577209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.577337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.577498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.577593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.577713] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 already deleted. [ 631.577817] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.807312] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.807469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.807514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.807746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.807815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.807989] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.808181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.808181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.808334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.808414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.808819] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 is going to be updated. [ 631.849922] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.849922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.849922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.849922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.849922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.859828] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 in Status: IN_PROGRESS for 2s [ 632.022662] env[65446]: INFO networking_nsxv3.common.synchronization [req-bbf7cd58-456f-4501-abf2-4b63c3cc63bc req-04b384b8-cf8c-4921-b578-67e7a0c09cf5 service nova] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_rules [ 632.022873] env[65446]: INFO networking_nsxv3.common.synchronization [req-bbf7cd58-456f-4501-abf2-4b63c3cc63bc req-04b384b8-cf8c-4921-b578-67e7a0c09cf5 service nova] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 632.023255] env[65446]: INFO networking_nsxv3.common.synchronization [req-bbf7cd58-456f-4501-abf2-4b63c3cc63bc req-04b384b8-cf8c-4921-b578-67e7a0c09cf5 service nova] Enqueued Resource ID: ece21177-c97a-4b0c-a39e-f7e0f9fcea09 with Priority: HIGHEST for action port [ 632.023563] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_rules [ 632.023706] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 632.023813] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ece21177-c97a-4b0c-a39e-f7e0f9fcea09 with Priority: HIGHEST for action port [ 632.025055] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.025975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.025975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.025975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.025975] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.026643] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.026811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.026892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.027145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.027319] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.027456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.027496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.027622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.027737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.027868] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.028956] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.029096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.029165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.029333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.029418] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece21177-c97a-4b0c-a39e-f7e0f9fcea09',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.535271] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.535271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.535271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.535271] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ece21177-c97a-4b0c-a39e-f7e0f9fcea09 with status ACTIVE [ 632.535271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.535271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.535271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.535271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.535949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.535949] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.535949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.535949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.535949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.535949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.536625] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.540373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.540373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.540456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.540488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.540569] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ece21177-c97a-4b0c-a39e-f7e0f9fcea09 is going to be updated. [ 632.563815] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.563956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.564037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.564267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.565186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.565186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ece21177-c97a-4b0c-a39e-f7e0f9fcea09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.636401] env[65446]: INFO networking_nsxv3.common.synchronization [req-5f556cc3-2f89-4cc9-a867-c431bde3ec86 req-73f55c7b-3bec-4ab1-9a68-8464eefae2b0 tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 632.637261] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 632.637261] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.637471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.637471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.637759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.637759] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.637910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.637945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.638730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.638730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.638730] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.872850] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 632.873095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.042749] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.054105] env[65446]: INFO networking_nsxv3.common.synchronization [None req-cc79fd36-51c4-49b2-860a-ceac7609b764 None None] Enqueued Resource ID: 082a48a8-910a-4ac2-9651-a46883eb07db with Priority: HIGHEST for action port [ 633.054411] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082a48a8-910a-4ac2-9651-a46883eb07db with Priority: HIGHEST for action port [ 633.054567] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-082a48a8-910a-4ac2-9651-a46883eb07db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.054723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-082a48a8-910a-4ac2-9651-a46883eb07db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.054804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-082a48a8-910a-4ac2-9651-a46883eb07db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.055997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-082a48a8-910a-4ac2-9651-a46883eb07db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.056212] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('082a48a8-910a-4ac2-9651-a46883eb07db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.141169] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.141414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.141548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.142121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.142121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.142271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.142438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.142528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.142719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.142823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.142934] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 633.186639] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.186639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.186639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.187011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.187011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.199469] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 633.545839] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.546356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.546356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.546486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.549588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.549588] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be created. [ 633.559208] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 082a48a8-910a-4ac2-9651-a46883eb07db [ 633.559552] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.559730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.559831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.560091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.560169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.560295] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:082a48a8-910a-4ac2-9651-a46883eb07db already deleted. [ 633.560406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-082a48a8-910a-4ac2-9651-a46883eb07db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.582613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.582850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.582980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.583348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.583626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.595543] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: UNINITIALIZED for 2s [ 633.870323] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 in Status: SUCCESS [ 633.870800] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 deletion is rescheduled due to dependency. [ 633.870800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.250871] env[65446]: INFO networking_nsxv3.common.synchronization [req-c21b4c7d-262e-45fe-be1b-01b59dd5d217 req-fb595b75-5be2-47d5-8854-0aef28f88ce0 tempest-SecurityGroupRulesTestJSON-1365411131 tempest-SecurityGroupRulesTestJSON-1365411131-project-member] Enqueued Resource ID: c1a23e41-31cf-4856-a4f3-55b2d0d81f02 with Priority: HIGHEST for action security_group_rules [ 634.251501] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1a23e41-31cf-4856-a4f3-55b2d0d81f02 with Priority: HIGHEST for action security_group_rules [ 634.251868] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1a23e41-31cf-4856-a4f3-55b2d0d81f02 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.252206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1a23e41-31cf-4856-a4f3-55b2d0d81f02" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.252206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1a23e41-31cf-4856-a4f3-55b2d0d81f02" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.252381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1a23e41-31cf-4856-a4f3-55b2d0d81f02" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.252488] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1a23e41-31cf-4856-a4f3-55b2d0d81f02',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.780473] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.781034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.781034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.781034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.781034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.781187] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1a23e41-31cf-4856-a4f3-55b2d0d81f02 already deleted. [ 634.781187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1a23e41-31cf-4856-a4f3-55b2d0d81f02" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.002484] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7291ce03-9150-45b1-a266-37679df556cf None None] Enqueued Resource ID: fa3b6eb9-d6d4-4522-93b9-50a56a959008 with Priority: HIGHEST for action port [ 635.003846] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa3b6eb9-d6d4-4522-93b9-50a56a959008 with Priority: HIGHEST for action port [ 635.003846] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa3b6eb9-d6d4-4522-93b9-50a56a959008 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.003846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa3b6eb9-d6d4-4522-93b9-50a56a959008" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.003846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa3b6eb9-d6d4-4522-93b9-50a56a959008" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.004188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa3b6eb9-d6d4-4522-93b9-50a56a959008" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.004229] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa3b6eb9-d6d4-4522-93b9-50a56a959008',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.216061] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 4s [ 635.440656] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-dd921e92-5288-44fb-8051-7582454a0d2a tempest-ListServersNegativeTestJSON-366548564 tempest-ListServersNegativeTestJSON-366548564-project-member] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 635.441309] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 635.441424] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.441551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.441615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.441967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.442066] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.442157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.442225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.442371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.442453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.442580] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.511390] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa3b6eb9-d6d4-4522-93b9-50a56a959008 [ 635.511390] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.512774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.512872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.513238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.513238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.513350] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa3b6eb9-d6d4-4522-93b9-50a56a959008 already deleted. [ 635.513445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa3b6eb9-d6d4-4522-93b9-50a56a959008" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.611347] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: SUCCESS [ 635.611568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.611754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.611955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.612217] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.613232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.613232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.613232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.613232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.613232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.613232] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.948921] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.948921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.948921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.948921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.948921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.948921] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.948921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.949514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.949891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.949891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.949891] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 already deleted. [ 635.950037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.963360] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.963761] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.964377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.964806] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.965175] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.965924] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.966224] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.966494] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.966642] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.966858] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.966969] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.967109] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.967218] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.967323] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.967423] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.967553] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.990821] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.990821] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.990821] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.991069] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.992270] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-6489ebca-d4f4-45b7-9345-41063aa371c5 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.992270] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.992270] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.992270] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.992270] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6489ebca-d4f4-45b7-9345-41063aa371c5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.116539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.116715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.116868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.117009] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.119069] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.119069] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.119069] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.119069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.119876] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.494968] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.495153] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.495322] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.495599] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.495711] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.495823] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 6489ebca-d4f4-45b7-9345-41063aa371c5 not found, creating... [ 636.496134] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.496258] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.496362] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.496591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.496762] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.497035] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.497180] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.497312] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.497500] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.497633] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.497804] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 6489ebca-d4f4-45b7-9345-41063aa371c5 is going to be created. [ 636.519650] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.519820] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.519864] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.520191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.520425] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.520649] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.622950] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56ef744e-edae-484b-8821-4f332fd192db: rpc.has_security_group_logging(os_id): False [ 636.647923] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.650669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.650669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.650669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.650669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.650669] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.650669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.650669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.652024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.652024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.655542] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.655542] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.655542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.655542] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be created. [ 636.727752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.727752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.727752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.727752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.727752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.738422] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: IN_PROGRESS for 2s [ 637.224935] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 637.225282] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 637.225282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.262306] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-244c857b-bbad-44f9-baa0-44ecf3791a1d service nova] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_rules [ 637.262481] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-244c857b-bbad-44f9-baa0-44ecf3791a1d service nova] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 637.262833] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-244c857b-bbad-44f9-baa0-44ecf3791a1d service nova] Enqueued Resource ID: 6489ebca-d4f4-45b7-9345-41063aa371c5 with Priority: HIGHEST for action port [ 637.263696] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_rules [ 637.263772] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 637.263900] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6489ebca-d4f4-45b7-9345-41063aa371c5 with Priority: HIGHEST for action port [ 637.264209] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.264330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.264394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.264731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.264809] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.265754] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.265754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.265862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.266116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.266187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.266252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.266295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.266429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.266552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.266825] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.268542] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6489ebca-d4f4-45b7-9345-41063aa371c5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.268542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.268542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.268542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.268542] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6489ebca-d4f4-45b7-9345-41063aa371c5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.773528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.773528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.773528] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.773528] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6489ebca-d4f4-45b7-9345-41063aa371c5 with status ACTIVE [ 637.773528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.773528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.773528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.773528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.773528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.773528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.773528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.774204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.774204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.774204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.774204] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.774588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.774724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.774945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.775203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.775339] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6489ebca-d4f4-45b7-9345-41063aa371c5 is going to be updated. [ 637.801786] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.802031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.802120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.802360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.802519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.802711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6489ebca-d4f4-45b7-9345-41063aa371c5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.956260] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-2283cdc0-a2ad-4d10-8269-65da19c84ae7 tempest-ListServersNegativeTestJSON-366548564 tempest-ListServersNegativeTestJSON-366548564-project-member] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 637.956970] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 637.957405] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.957524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.277477] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.489660] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.489660] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.489660] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.490604] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.490604] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.490604] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.490819] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.491031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.491256] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.491583] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.491773] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.491904] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.492107] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.492268] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.492725] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.492725] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.516435] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.516610] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.516748] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.516926] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.517524] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-545ebcad-5f2d-483f-be21-ca2834fe8f09 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.517717] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.517837] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.518192] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.518331] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('545ebcad-5f2d-483f-be21-ca2834fe8f09',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.757331] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: SUCCESS [ 638.757743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.780488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.780638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.780638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.780967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.781078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.781197] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be created. [ 638.806402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.806633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.806633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.806811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.807068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.818780] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: UNINITIALIZED for 2s [ 639.025188] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.025662] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.025662] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.025920] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.026065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.026188] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 545ebcad-5f2d-483f-be21-ca2834fe8f09 not found, creating... [ 639.026447] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.026704] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.028500] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.028863] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.029667] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.029988] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.030101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.031781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.031781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.031781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.031781] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 545ebcad-5f2d-483f-be21-ca2834fe8f09 is going to be created. [ 639.059559] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.059797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.059921] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.064017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.064017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.064017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.778285] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-b7402d92-59c5-4b09-b279-5ef5167cd59e service nova] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_rules [ 639.778521] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-b7402d92-59c5-4b09-b279-5ef5167cd59e service nova] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 639.778521] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-b7402d92-59c5-4b09-b279-5ef5167cd59e service nova] Enqueued Resource ID: 545ebcad-5f2d-483f-be21-ca2834fe8f09 with Priority: HIGHEST for action port [ 639.779355] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_rules [ 639.779355] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 639.779355] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 545ebcad-5f2d-483f-be21-ca2834fe8f09 with Priority: HIGHEST for action port [ 639.779560] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.779629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.779824] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.779907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.780167] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-545ebcad-5f2d-483f-be21-ca2834fe8f09 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.780279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.780341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.780535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.780614] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('545ebcad-5f2d-483f-be21-ca2834fe8f09',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.282194] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 545ebcad-5f2d-483f-be21-ca2834fe8f09 with status ACTIVE [ 640.282451] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.283049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.283049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.283049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.283254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.283359] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.283493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.283553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.283775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.283881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.284131] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.284244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.284308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.284503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.284607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.284701] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 545ebcad-5f2d-483f-be21-ca2834fe8f09 is going to be updated. [ 640.313046] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.313046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.313046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.313046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.313046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.315018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-545ebcad-5f2d-483f-be21-ca2834fe8f09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.604117] env[65446]: INFO networking_nsxv3.common.synchronization [None req-41836993-95ae-4fb6-a675-86bc173269c3 None None] Enqueued Resource ID: 4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b with Priority: HIGHEST for action port [ 640.604117] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b with Priority: HIGHEST for action port [ 640.605731] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.606851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.606851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.606851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.606851] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.831097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 640.831456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.831694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.832159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.832455] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.832758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.832898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.833157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.833312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.833476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.833626] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.835159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.835405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.835656] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.835847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.835955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.836182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.836391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.836481] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.108671] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b [ 641.109588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.109588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.109588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.109588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.109588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.109588] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b already deleted. [ 641.109588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a1421ae-8d8d-40e3-a5cf-0caf54a97b6b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.296554] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-6563291c-cb95-4a11-9ded-e26001a2fe93 tempest-ListServersNegativeTestJSON-366548564 tempest-ListServersNegativeTestJSON-366548564-project-member] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 641.297147] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 641.297457] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.297559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.338548] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.340412] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.340538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.710743] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.710949] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.711072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.711372] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.711990] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.711990] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.711990] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.712250] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.712581] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.712679] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.712799] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.713602] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.713602] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.713602] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.713602] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.713602] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.740430] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.740430] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.740430] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.740430] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-578" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.740430] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-106c2983-1cec-492c-9cbd-a652d8a4efd4 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.740430] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.740430] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.741738] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.741738] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('106c2983-1cec-492c-9cbd-a652d8a4efd4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.841769] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.245018] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.245275] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.245403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.245689] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.245842] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.245994] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 106c2983-1cec-492c-9cbd-a652d8a4efd4 not found, creating... [ 642.246298] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.246479] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.246597] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.246822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.246992] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.247281] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.247434] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.247550] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.247817] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.247978] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.248131] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 106c2983-1cec-492c-9cbd-a652d8a4efd4 is going to be created. [ 642.270071] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.270565] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.270708] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.270990] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.271240] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.271462] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.345570] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.345570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.345570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.345857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.346023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.346189] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 642.376359] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.376543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.376593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.377353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.377353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.387166] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 642.807856] env[65446]: INFO networking_nsxv3.common.synchronization [req-e2ae6bb3-da3e-43ec-b909-63e35e14455b req-0b7046bc-2c45-4ac0-ba9b-317f863bf139 tempest-DeleteServersAdminTestJSON-331057081 tempest-DeleteServersAdminTestJSON-331057081-project-member] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 642.808395] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 642.810425] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.810698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.810798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.811084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.812382] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.812382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.812382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.812382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.812382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.812382] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.910964] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e1e18475-1c4c-4bd4-b380-be8125078709 None None] Enqueued Resource ID: 64a693ec-e35a-4a2a-a005-94583fad4bee with Priority: HIGHEST for action port [ 642.911456] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64a693ec-e35a-4a2a-a005-94583fad4bee with Priority: HIGHEST for action port [ 642.911767] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-64a693ec-e35a-4a2a-a005-94583fad4bee taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.911925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64a693ec-e35a-4a2a-a005-94583fad4bee" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.911925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64a693ec-e35a-4a2a-a005-94583fad4bee" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.912179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64a693ec-e35a-4a2a-a005-94583fad4bee" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.912331] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64a693ec-e35a-4a2a-a005-94583fad4bee',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.030590] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-011ac17f-97ce-4547-9353-e066d5f741c4 service nova] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_rules [ 643.030773] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-011ac17f-97ce-4547-9353-e066d5f741c4 service nova] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 643.031062] env[65446]: INFO networking_nsxv3.common.synchronization [req-aacf6ada-8fbc-49e3-b1a5-f230c92578ca req-011ac17f-97ce-4547-9353-e066d5f741c4 service nova] Enqueued Resource ID: 106c2983-1cec-492c-9cbd-a652d8a4efd4 with Priority: HIGHEST for action port [ 643.031491] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_rules [ 643.032110] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 643.032210] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 106c2983-1cec-492c-9cbd-a652d8a4efd4 with Priority: HIGHEST for action port [ 643.032514] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.032638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.033088] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.033088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.033206] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-106c2983-1cec-492c-9cbd-a652d8a4efd4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.033281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.033555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.033731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.033844] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('106c2983-1cec-492c-9cbd-a652d8a4efd4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.286642] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.286642] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.286642] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.286852] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.287670] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.287863] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.287981] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.288224] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.288368] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.288572] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.288683] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.288786] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.288889] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.288993] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.289116] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.289244] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.310639] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.310885] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.311046] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.311226] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.311548] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-23749a75-b3aa-4a7a-9bb1-414065fd7175 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.311731] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.311853] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.312217] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.312363] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23749a75-b3aa-4a7a-9bb1-414065fd7175',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.314363] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.314761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.314904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.315210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.315358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.315607] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.315894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.315894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.316144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.316253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.316384] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be updated. [ 643.346758] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.347021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.347079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.347294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.347437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.358504] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: IN_PROGRESS for 2s [ 643.416780] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64a693ec-e35a-4a2a-a005-94583fad4bee [ 643.416780] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.416780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.416780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.416780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.416780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.416780] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64a693ec-e35a-4a2a-a005-94583fad4bee already deleted. [ 643.416780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64a693ec-e35a-4a2a-a005-94583fad4bee" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.537053] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 106c2983-1cec-492c-9cbd-a652d8a4efd4 with status ACTIVE [ 643.537286] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.537517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.537517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.541133] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.541133] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.541133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.541133] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 106c2983-1cec-492c-9cbd-a652d8a4efd4 is going to be updated. [ 643.562406] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.562572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.562803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.562880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.562956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.563128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-106c2983-1cec-492c-9cbd-a652d8a4efd4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.816573] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.816888] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.817055] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.817407] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.817611] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.817819] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 23749a75-b3aa-4a7a-9bb1-414065fd7175 not found, creating... [ 643.818194] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.818884] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.818884] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.818884] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.819284] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.819756] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.819852] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.820152] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.820320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.820517] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.820709] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 23749a75-b3aa-4a7a-9bb1-414065fd7175 is going to be created. [ 643.846557] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.846736] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.847017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.847160] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.847369] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.847601] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.398965] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 644.399422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.399542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.399783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.400414] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.400587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.400661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.400838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.400925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.401038] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.549215] env[65446]: INFO networking_nsxv3.common.synchronization [req-e2ae6bb3-da3e-43ec-b909-63e35e14455b req-ad3bf09e-ed05-40e7-abf3-ebb0dc19faec service nova] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_rules [ 644.549215] env[65446]: INFO networking_nsxv3.common.synchronization [req-e2ae6bb3-da3e-43ec-b909-63e35e14455b req-ad3bf09e-ed05-40e7-abf3-ebb0dc19faec service nova] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 644.549215] env[65446]: INFO networking_nsxv3.common.synchronization [req-e2ae6bb3-da3e-43ec-b909-63e35e14455b req-ad3bf09e-ed05-40e7-abf3-ebb0dc19faec service nova] Enqueued Resource ID: 23749a75-b3aa-4a7a-9bb1-414065fd7175 with Priority: HIGHEST for action port [ 644.549215] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_rules [ 644.549215] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 644.549215] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23749a75-b3aa-4a7a-9bb1-414065fd7175 with Priority: HIGHEST for action port [ 644.549215] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.549890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.550092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.550415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.553089] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.553089] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.553089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.553089] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-23749a75-b3aa-4a7a-9bb1-414065fd7175 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.553089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.553089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.553089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.553089] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23749a75-b3aa-4a7a-9bb1-414065fd7175',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.903815] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.058341] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.058341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23749a75-b3aa-4a7a-9bb1-414065fd7175 with status ACTIVE [ 645.058341] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.058341] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.058341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.058341] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.058905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.058905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.058905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.058905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.058905] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23749a75-b3aa-4a7a-9bb1-414065fd7175 is going to be updated. [ 645.083245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.083489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.083637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.083926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.084153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.084551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23749a75-b3aa-4a7a-9bb1-414065fd7175" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.371399] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: SUCCESS [ 645.371714] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 deletion is rescheduled due to dependency. [ 645.373510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.373510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.373510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.373510] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.373510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.373510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.373510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.373510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.373510] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.406088] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.875770] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.908500] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.908657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.908731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.908944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.909072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.909179] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 645.941625] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.941836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.941871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.942076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.942278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.953263] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 646.078300] env[65446]: INFO networking_nsxv3.common.synchronization [req-abdcafc5-2294-4758-9a86-10d49996a53c req-3229e145-bab9-45e2-a1ed-52d519942982 tempest-SecurityGroupRulesTestJSON-1365411131 tempest-SecurityGroupRulesTestJSON-1365411131-project-member] Enqueued Resource ID: f1266de5-f70e-4e4a-a3c0-d6eee316dc32 with Priority: HIGHEST for action security_group_rules [ 646.078300] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1266de5-f70e-4e4a-a3c0-d6eee316dc32 with Priority: HIGHEST for action security_group_rules [ 646.078702] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1266de5-f70e-4e4a-a3c0-d6eee316dc32 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.078702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1266de5-f70e-4e4a-a3c0-d6eee316dc32" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.080260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1266de5-f70e-4e4a-a3c0-d6eee316dc32" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.080584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1266de5-f70e-4e4a-a3c0-d6eee316dc32" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.080688] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1266de5-f70e-4e4a-a3c0-d6eee316dc32',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.230298] env[65446]: INFO networking_nsxv3.common.synchronization [req-4468dd56-829b-43e4-88ae-2eaf61851d1b req-9c2e9977-73c0-4b6d-902d-e0fedde39e6a tempest-SecurityGroupRulesNegativeTestJSON-760854361 tempest-SecurityGroupRulesNegativeTestJSON-760854361-project-member] Enqueued Resource ID: 8416dd3f-8aa7-44c9-a86f-dff982c60b92 with Priority: HIGHEST for action security_group_rules [ 646.231681] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8416dd3f-8aa7-44c9-a86f-dff982c60b92 with Priority: HIGHEST for action security_group_rules [ 646.233863] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.233863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.233863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.233863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.233863] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8416dd3f-8aa7-44c9-a86f-dff982c60b92',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.380885] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.604402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.604402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.604402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.605058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.605058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.605058] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1266de5-f70e-4e4a-a3c0-d6eee316dc32 already deleted. [ 646.605058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1266de5-f70e-4e4a-a3c0-d6eee316dc32" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.753881] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.754096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.754146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.754417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.754522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.754938] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8416dd3f-8aa7-44c9-a86f-dff982c60b92 already deleted. [ 646.754938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.825829] env[65446]: INFO networking_nsxv3.common.synchronization [req-b16e07c2-7090-44a5-9e1c-e3ef4e3fadce req-b1353852-4356-4f8b-b477-8ee53f836a76 tempest-ServerExternalEventsTest-1427882636 tempest-ServerExternalEventsTest-1427882636-project-member] Enqueued Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_members [ 646.826624] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGHEST for action security_group_members [ 646.827018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.827974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.828084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.828275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.828450] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.828549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.828630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.828772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.828874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.828959] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.886278] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.886278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.886278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.886278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.886278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.886278] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be updated. [ 646.927257] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.927442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.927507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.927756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.927946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.945199] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: IN_PROGRESS for 2s [ 647.310028] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-d7e1fcd4-ff3f-43ce-b0d1-e3b4b5f65ed0 tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 647.310028] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 647.310222] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.310299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.310335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.310687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.310826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.310933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.313928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.314051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.314097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.314733] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.334239] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.334331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.334406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.334621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.334774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.334948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.336138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.336262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.336433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.336599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.336651] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9add5c-c992-43ca-9245-5304b7194290 is going to be updated. [ 647.372286] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.372436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.372633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.372803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.372870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.381773] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9add5c-c992-43ca-9245-5304b7194290 in Status: IN_PROGRESS for 2s [ 647.818306] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.818622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.818622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.819655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.819774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.820020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.820148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.820214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.820382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.820456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.820542] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 already deleted. [ 647.820625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.945951] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.946174] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.946296] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.946630] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.947101] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.947265] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.947447] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.947610] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.947856] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.948085] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.948259] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.948319] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.948413] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.948519] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.948620] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.948748] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.963068] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 647.963068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.963344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.963426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.963631] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.963743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.963810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.963963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.964063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.964159] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.970975] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.971136] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.971197] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.971343] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.972201] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-8f26ad91-e59b-4a1a-8b30-ab7001faf882 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.972201] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.972201] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.972441] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.972441] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f26ad91-e59b-4a1a-8b30-ab7001faf882',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.466894] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.475343] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.475343] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.475343] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.475602] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.475813] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.475895] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 8f26ad91-e59b-4a1a-8b30-ab7001faf882 not found, creating... [ 648.476129] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.476276] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.476381] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.476588] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.476950] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.477121] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.477197] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.477289] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.477495] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.477785] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.477785] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 8f26ad91-e59b-4a1a-8b30-ab7001faf882 is going to be created. [ 648.501582] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.501799] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.501986] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.502504] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.502613] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.502848] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.957113] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: SUCCESS [ 648.958071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.958071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.958302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.958369] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.958516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.958573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.958730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.958834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.958934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.959374] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.970235] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.274124] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-5b800719-c18f-4f14-86bb-8490d369bcdb service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 649.274209] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-5b800719-c18f-4f14-86bb-8490d369bcdb service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 649.274411] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-5b800719-c18f-4f14-86bb-8490d369bcdb service nova] Enqueued Resource ID: 8f26ad91-e59b-4a1a-8b30-ab7001faf882 with Priority: HIGHEST for action port [ 649.276953] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 649.276953] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 649.277788] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f26ad91-e59b-4a1a-8b30-ab7001faf882 with Priority: HIGHEST for action port [ 649.278176] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.278731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.278731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.279804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.279804] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.280862] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.280862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.280862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.281976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.281976] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.282168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.282316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.282534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.282663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.282798] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.284344] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f26ad91-e59b-4a1a-8b30-ab7001faf882 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.284564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.285668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.285668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.285668] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f26ad91-e59b-4a1a-8b30-ab7001faf882',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.392171] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9add5c-c992-43ca-9245-5304b7194290 in Status: SUCCESS [ 649.392365] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9add5c-c992-43ca-9245-5304b7194290 deletion is rescheduled due to dependency. [ 649.392484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.461600] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.461850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.461850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.462559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.462559] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.462559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.462559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.462559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.462916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.462916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.462916] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.463040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.463040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.463169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.463306] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.463398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.463457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.463594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.463668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.465268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.465268] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.474265] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.474265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.474265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.475940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.476077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.476165] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 649.505321] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.505501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.505552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.505853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.505927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.516059] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 649.788218] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.795021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.795021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.795664] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f26ad91-e59b-4a1a-8b30-ab7001faf882 with status ACTIVE [ 649.797318] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.797657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.797792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.799030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.799147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.799481] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.801887] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.801887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.801887] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f26ad91-e59b-4a1a-8b30-ab7001faf882 is going to be updated. [ 649.829695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.829695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.830141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.830355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.830898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.831115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f26ad91-e59b-4a1a-8b30-ab7001faf882" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.974615] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8ff462b-9472-43fc-a79a-f055dbe02c56: rpc.has_security_group_logging(os_id): False [ 650.003933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.004419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.004419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.004419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.004576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.004797] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.006101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.006101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.006518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.006518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.006518] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.006734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.006734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.006871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.006871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.007501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.007501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.007501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.009250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.009250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.009250] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be updated. [ 650.136040] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.136206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.136278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.136530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.136686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.157136] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: IN_PROGRESS for 2s [ 650.307189] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.454097] env[65446]: INFO networking_nsxv3.common.synchronization [req-9ff62b4b-73fb-4534-9572-cbd2d567f323 req-e807c997-2cf4-4bc9-879c-196893ba74ab tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 650.454725] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 650.455046] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.455180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.455246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.455472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.455630] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.455732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.455794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.455944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.456900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.456900] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.810456] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.810613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.810762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.810907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.810994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.811129] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be created. [ 650.842517] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.842775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.842775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.843776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.844896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.862972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: UNINITIALIZED for 2s [ 650.960787] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.001671] env[65446]: INFO networking_nsxv3.common.synchronization [req-9ff62b4b-73fb-4534-9572-cbd2d567f323 req-c0015c13-1e5e-4796-9432-9fe7a27bdc24 tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 651.001671] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 651.003066] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.003253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.465017] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.526907] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 651.527212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.527349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.527560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.527794] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.527921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.527981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.528199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.528257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.528322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.528494] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.528591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.528650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.528837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.528980] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.530202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.530202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.530202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.530202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.530202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.530202] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.532180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.532356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.532504] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.532614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.532777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.532841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.532955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.533025] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.535602] env[65446]: INFO networking_nsxv3.common.synchronization [req-9ff62b4b-73fb-4534-9572-cbd2d567f323 req-bfa174f7-1ee1-407a-9c88-0a09caf6dd47 tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 651.536446] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 651.537373] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.537373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.968956] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.969904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.970632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.971088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.971336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.971560] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 652.008036] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.008389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.008389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.008389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.008508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.020361] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 652.033331] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4638bd1f-1a25-47b3-8d6b-16a31f179b47: rpc.has_security_group_logging(os_id): False [ 652.037761] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.052658] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.056041] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.056041] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.056041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.056736] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.056736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.056736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.056736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.056736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.056736] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be created. [ 652.140285] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.140460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.140506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.140705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.140899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.155023] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 652.179770] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: SUCCESS [ 652.180048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.400922] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c49c8519-929b-48c5-8316-fd9f74fc46e5 None None] Enqueued Resource ID: 0b36cbd0-44ce-47fd-9866-b81e8f5c8dff with Priority: HIGHEST for action port [ 652.400922] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b36cbd0-44ce-47fd-9866-b81e8f5c8dff with Priority: HIGHEST for action port [ 652.400922] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b36cbd0-44ce-47fd-9866-b81e8f5c8dff taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.400922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b36cbd0-44ce-47fd-9866-b81e8f5c8dff" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.400922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b36cbd0-44ce-47fd-9866-b81e8f5c8dff" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.400922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b36cbd0-44ce-47fd-9866-b81e8f5c8dff" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.400922] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b36cbd0-44ce-47fd-9866-b81e8f5c8dff',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.539831] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.628698] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-fffe5dd9-5443-4104-ab51-249868902150 tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 652.630034] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 652.630397] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.630512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.873654] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 652.874103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.874308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.874546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.874806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.874936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.875009] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.875184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.875259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.875343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.875439] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.876309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.876495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.876661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.876767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.876829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.876968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.877397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877614] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.903769] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b36cbd0-44ce-47fd-9866-b81e8f5c8dff [ 652.904406] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.904694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.904694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.904927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.904987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.905228] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b36cbd0-44ce-47fd-9866-b81e8f5c8dff already deleted. [ 652.905228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b36cbd0-44ce-47fd-9866-b81e8f5c8dff" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.985129] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e8c53f1b-0ebb-44a0-88c3-a7aaf64cd33f None None] Enqueued Resource ID: d12f0b1c-6987-4cf8-92fd-86c6309c28a9 with Priority: HIGHEST for action port [ 652.985535] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d12f0b1c-6987-4cf8-92fd-86c6309c28a9 with Priority: HIGHEST for action port [ 652.985992] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d12f0b1c-6987-4cf8-92fd-86c6309c28a9 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.985992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d12f0b1c-6987-4cf8-92fd-86c6309c28a9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.985992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d12f0b1c-6987-4cf8-92fd-86c6309c28a9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.986410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d12f0b1c-6987-4cf8-92fd-86c6309c28a9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.986509] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d12f0b1c-6987-4cf8-92fd-86c6309c28a9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.042184] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.043047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.045229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.045229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.045229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.045229] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 653.079050] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.079050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.079050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.079050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.081021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.091087] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 653.121068] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.121068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.121068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.121279] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.121543] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.121695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.121813] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.122013] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.127730] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.127941] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.128067] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.128178] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.128284] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.128391] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.128565] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.128624] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.151027] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.151027] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.151027] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.151027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.151027] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.151027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.151027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.151027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.151027] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.380502] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.380502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.380502] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.493086] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d12f0b1c-6987-4cf8-92fd-86c6309c28a9 [ 653.493358] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.493505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.493574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.493791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.493898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.494016] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d12f0b1c-6987-4cf8-92fd-86c6309c28a9 already deleted. [ 653.494084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d12f0b1c-6987-4cf8-92fd-86c6309c28a9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.653176] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.654182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.654182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.654336] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.655465] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.655465] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 not found, creating... [ 653.655465] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.655465] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.655719] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.655755] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.657320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.659698] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.659698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.659698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.659698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.659931] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.659931] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 is going to be created. [ 653.681882] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.681882] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.681882] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.682423] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.682489] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.682800] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.883687] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.017154] env[65446]: INFO networking_nsxv3.common.synchronization [req-7e93d9a1-c3d4-4616-9dc4-21ddc90d8dd9 req-c7c35f56-0ebc-4250-9b02-53536e9b4c7d tempest-SecurityGroupRulesNegativeTestJSON-760854361 tempest-SecurityGroupRulesNegativeTestJSON-760854361-project-member] Enqueued Resource ID: 8416dd3f-8aa7-44c9-a86f-dff982c60b92 with Priority: HIGHEST for action security_group_rules [ 654.017950] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8416dd3f-8aa7-44c9-a86f-dff982c60b92 with Priority: HIGHEST for action security_group_rules [ 654.018198] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.018198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.018198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.018401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.018481] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8416dd3f-8aa7-44c9-a86f-dff982c60b92',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.030042] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 654.030291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.030471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.030679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.030866] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.030994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.031182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.031220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.031296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.031391] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.168651] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 654.169039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.169088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.169286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.169452] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.389023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.389023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.389023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.389023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.389023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.389023] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 654.397258] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-30c7ac2b-f371-41bf-81e2-3635bb89cf3d service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 654.397258] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-30c7ac2b-f371-41bf-81e2-3635bb89cf3d service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 654.397258] env[65446]: INFO networking_nsxv3.common.synchronization [req-b0e9ecec-b2bf-4ea8-8779-3917624825a2 req-30c7ac2b-f371-41bf-81e2-3635bb89cf3d service nova] Enqueued Resource ID: b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 with Priority: HIGHEST for action port [ 654.397258] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 654.397258] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 654.397258] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 with Priority: HIGHEST for action port [ 654.397258] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.397258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.398780] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.399024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.399813] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.400508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.400700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.400983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.401180] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.420690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.423020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.423020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.423020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.423020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.432905] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 654.533360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.536436] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.536436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.536436] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 654.542240] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.542240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.542240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.542240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.542240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.542240] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8416dd3f-8aa7-44c9-a86f-dff982c60b92 already deleted. [ 654.542240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8416dd3f-8aa7-44c9-a86f-dff982c60b92" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.569447] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.569746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.569746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.570117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.570333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.584214] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 654.673135] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.673135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.903966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 with status ACTIVE [ 654.904113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.904308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.904418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.904858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.904987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.905188] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.905300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.905661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.905718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.906299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.906299] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.906299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.907125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.907125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.907125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.907125] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8 is going to be updated. [ 654.930311] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.930653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.930653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.930954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.931184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.931419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7cc6d3e-89ad-47ba-a61c-dbd6188d7de8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.949514] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c3d8ec47-efc8-4b1a-95f3-5012fd9ae104 None None] Enqueued Resource ID: dd5669ea-57cd-4cc6-b576-22fd23032858 with Priority: HIGHEST for action port [ 654.949514] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5669ea-57cd-4cc6-b576-22fd23032858 with Priority: HIGHEST for action port [ 654.949973] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd5669ea-57cd-4cc6-b576-22fd23032858 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.950134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd5669ea-57cd-4cc6-b576-22fd23032858" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.950213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd5669ea-57cd-4cc6-b576-22fd23032858" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.950431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd5669ea-57cd-4cc6-b576-22fd23032858" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.950504] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd5669ea-57cd-4cc6-b576-22fd23032858',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.106031] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 655.106291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.106539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.106833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.107103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.107404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.107404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.107505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.107594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.107738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.107886] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.455159] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd5669ea-57cd-4cc6-b576-22fd23032858 [ 655.455462] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.455557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.455615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.457034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.457034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.457034] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd5669ea-57cd-4cc6-b576-22fd23032858 already deleted. [ 655.457034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd5669ea-57cd-4cc6-b576-22fd23032858" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.553859] env[65446]: INFO networking_nsxv3.common.synchronization [None req-dc526815-b8da-4187-8fc3-10e26f66e0a8 None None] Enqueued Resource ID: 7b1055b5-f10b-4595-a181-f2002786268c with Priority: HIGHEST for action port [ 655.554598] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1055b5-f10b-4595-a181-f2002786268c with Priority: HIGHEST for action port [ 655.555821] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b1055b5-f10b-4595-a181-f2002786268c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.555821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b1055b5-f10b-4595-a181-f2002786268c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.555821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b1055b5-f10b-4595-a181-f2002786268c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.555821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b1055b5-f10b-4595-a181-f2002786268c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.555821] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b1055b5-f10b-4595-a181-f2002786268c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.613121] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.613121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.613309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.613456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.613659] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.613800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.613881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.613991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.614088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.614175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.614330] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.614415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.614475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.614662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.614828] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.614969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.615104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.615243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.615323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.615421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.615508] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.677951] env[65446]: INFO networking_nsxv3.common.synchronization [req-e9eaaa57-1022-4cda-bf61-9dde186e09ae req-df6beadc-170f-42a0-a7be-8b49c579aa5b tempest-ServersWithSpecificFlavorTestJSON-599263955 tempest-ServersWithSpecificFlavorTestJSON-599263955-project-member] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 655.677951] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 655.677951] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.677951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.677951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.680452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.680452] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.680452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.680452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.680452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.680452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.680835] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.060214] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b1055b5-f10b-4595-a181-f2002786268c [ 656.060214] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.060214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.060214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.060214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.060214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.060214] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b1055b5-f10b-4595-a181-f2002786268c already deleted. [ 656.060214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b1055b5-f10b-4595-a181-f2002786268c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.121707] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4638bd1f-1a25-47b3-8d6b-16a31f179b47: rpc.has_security_group_logging(os_id): False [ 656.142047] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.142047] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.142047] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.142047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.142976] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.146419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.146419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.146419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.146419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.146419] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 656.186078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.186078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.186078] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 already deleted. [ 656.186078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.211723] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.211889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.211936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.212783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.212783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.223022] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.223022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.223022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.223022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.223022] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.223022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.223022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.223022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.224209] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.224571] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.224856] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.227982] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.227982] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.227982] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.227982] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.227982] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.227982] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 656.249029] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.249029] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.249029] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.249029] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.249029] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-fc057619-cee8-4acb-a187-a49f33523aab taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.249029] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.249029] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.249029] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.249029] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc057619-cee8-4acb-a187-a49f33523aab',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.445727] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 656.446067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.446200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.446445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.446652] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.446811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.446885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.447019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.447133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.447230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.448258] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.448258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.448258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.448258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.448258] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.448258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.448258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.448258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.448645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.448645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.448645] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.449418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.449595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.449752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.449907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.449980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.450140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.450605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.450605] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.597892] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 656.598523] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 deletion is rescheduled due to dependency. [ 656.598721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.598998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.599357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.599657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.599863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.599991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.600297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.600442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.600610] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.752251] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.752725] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.752725] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.753236] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.753434] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.753598] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port fc057619-cee8-4acb-a187-a49f33523aab not found, creating... [ 656.753886] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.754067] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.754252] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.754467] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.754605] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.754962] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.755374] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.755508] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.755776] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.755951] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.756118] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: fc057619-cee8-4acb-a187-a49f33523aab is going to be created. [ 656.780980] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.781256] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.781394] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.781845] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.782024] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.782144] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.954913] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79c30290-ba80-4936-8673-39beeb72a136: rpc.has_security_group_logging(os_id): False [ 656.954913] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.972558] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.972782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.972782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.973657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.973657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.973657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.973657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.973657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.973657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.973657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.974175] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.974175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.974175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.974175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.974175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.974475] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.974899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.974899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.974899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.974899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.975102] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be created. [ 657.056337] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.056969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.057241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.057300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.057478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.072893] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 657.107587] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.107799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.107799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.108065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.108165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.108439] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.108543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.108543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.108917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.108917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.108917] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 657.143512] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.143512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.143512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.143512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.143512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.157021] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 657.457967] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.539586] env[65446]: INFO networking_nsxv3.common.synchronization [req-e9eaaa57-1022-4cda-bf61-9dde186e09ae req-2d0aef26-58ea-4111-9bf7-13095a824e37 service nova] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 657.539786] env[65446]: INFO networking_nsxv3.common.synchronization [req-e9eaaa57-1022-4cda-bf61-9dde186e09ae req-2d0aef26-58ea-4111-9bf7-13095a824e37 service nova] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 657.539963] env[65446]: INFO networking_nsxv3.common.synchronization [req-e9eaaa57-1022-4cda-bf61-9dde186e09ae req-2d0aef26-58ea-4111-9bf7-13095a824e37 service nova] Enqueued Resource ID: fc057619-cee8-4acb-a187-a49f33523aab with Priority: HIGHEST for action port [ 657.540524] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 657.540714] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 657.540805] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc057619-cee8-4acb-a187-a49f33523aab with Priority: HIGHEST for action port [ 657.541104] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.541232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.541305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.541544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.541643] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.544385] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.544526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.544595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.544838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.545013] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.545129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.545193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.545375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.545472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.545566] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.546571] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc057619-cee8-4acb-a187-a49f33523aab taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.546571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.546702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.546771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.546842] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc057619-cee8-4acb-a187-a49f33523aab',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.960892] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.961319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.961319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.961454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.961512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.961602] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 657.994028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.994028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.994028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.994028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.994028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.003218] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 658.046365] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.046751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.049987] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc057619-cee8-4acb-a187-a49f33523aab with status ACTIVE [ 658.050234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.050386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.052109] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.052109] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.052109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.052109] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc057619-cee8-4acb-a187-a49f33523aab is going to be updated. [ 658.056535] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.079695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.079695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.079695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.079695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.079695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.080620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc057619-cee8-4acb-a187-a49f33523aab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.244089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 658.244308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.244487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.244724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.244900] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.558159] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.747210] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.747444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.747511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.747855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.748237] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.748357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.748433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.748602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.748684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.748778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.748874] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.970162] env[65446]: INFO networking_nsxv3.common.synchronization [req-92ce5fab-1cd6-4865-89ca-e96e2aac86e1 req-2ac9a7bf-dd95-4a4c-8733-ddd918c512cf tempest-InstanceActionsNegativeTestJSON-368243182 tempest-InstanceActionsNegativeTestJSON-368243182-project-member] Enqueued Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_members [ 658.970700] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_members [ 658.971023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.971153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.971217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.971478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.971640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.971765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.971805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.971949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.972172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.972460] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.063683] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.063683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.063683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.063683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.063683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.063683] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 is going to be created. [ 659.087205] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 659.087428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.087614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.087862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.087958] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.095079] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.095449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.095558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.095744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.096227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.108134] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: UNINITIALIZED for 2s [ 659.168125] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 659.168309] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 deletion is rescheduled due to dependency. [ 659.168387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.254074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.254074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.254074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.254863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.254863] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.254863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.254863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.255164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.255164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.256860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.256860] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.474535] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.474692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.474778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.475059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.475265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.475514] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.475514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.475514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.476016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.476016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.476016] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c already deleted. [ 659.476016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.592039] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.592181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.661983] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.662198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-527" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.662396] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-527" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.662784] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-527" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.663354] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.663515] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.663631] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.663860] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.663999] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.664214] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.664321] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.664591] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.664675] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.665143] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.665285] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.665498] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.686683] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.686683] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.686683] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.686898] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-527" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.688224] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-53104c72-b23b-4abf-abf0-b804e8530ce8 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.688224] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.688224] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.688224] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.688224] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53104c72-b23b-4abf-abf0-b804e8530ce8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.758697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4638bd1f-1a25-47b3-8d6b-16a31f179b47: rpc.has_security_group_logging(os_id): False [ 659.776240] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.776412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.776465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.776708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.776821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.777092] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.777220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.777285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.777474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.777561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.777772] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.777893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.777962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.778139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.778222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.778473] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.778594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.779233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.779233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.779233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.779233] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 659.860431] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.860703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.860776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.861106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.861320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.877698] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 660.017213] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 660.017671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.017671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.018077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.018148] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.018238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.018358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.018481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.018561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.018646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.018742] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.190258] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.190487] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.190611] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.190891] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.191076] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.191230] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 53104c72-b23b-4abf-abf0-b804e8530ce8 not found, creating... [ 660.191482] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.191649] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.191763] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.191986] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.192125] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.192531] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.192531] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.192681] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.192838] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.192970] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.195036] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 53104c72-b23b-4abf-abf0-b804e8530ce8 is going to be created. [ 660.218255] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.218628] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.218769] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.219082] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.219321] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.219549] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.521464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.521464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.521464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.522034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.522034] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.522836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.522942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.523152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.524017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.524017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.524757] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.525416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.525416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.525416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.525416] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.525416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.525678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.525678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.525678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.525800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.525911] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.779418] env[65446]: INFO networking_nsxv3.common.synchronization [req-2fbeea1b-c861-49df-a6c8-f08f38b6151e req-86f2fe5a-e46d-4763-88cc-937c3ca614f7 tempest-SecurityGroupRulesTestJSON-1365411131 tempest-SecurityGroupRulesTestJSON-1365411131-project-member] Enqueued Resource ID: 249a08f6-89c5-47f1-a97f-1184bef7140e with Priority: HIGHEST for action security_group_rules [ 660.779418] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249a08f6-89c5-47f1-a97f-1184bef7140e with Priority: HIGHEST for action security_group_rules [ 660.779418] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249a08f6-89c5-47f1-a97f-1184bef7140e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.779418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.779418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.779801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.780072] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249a08f6-89c5-47f1-a97f-1184bef7140e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.977992] env[65446]: INFO networking_nsxv3.common.synchronization [req-92ce5fab-1cd6-4865-89ca-e96e2aac86e1 req-d1e54bc6-eccf-455b-8f7b-e67090b5e405 service nova] Enqueued Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_rules [ 660.978288] env[65446]: INFO networking_nsxv3.common.synchronization [req-92ce5fab-1cd6-4865-89ca-e96e2aac86e1 req-d1e54bc6-eccf-455b-8f7b-e67090b5e405 service nova] Enqueued Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_members [ 660.978510] env[65446]: INFO networking_nsxv3.common.synchronization [req-92ce5fab-1cd6-4865-89ca-e96e2aac86e1 req-d1e54bc6-eccf-455b-8f7b-e67090b5e405 service nova] Enqueued Resource ID: 53104c72-b23b-4abf-abf0-b804e8530ce8 with Priority: HIGHEST for action port [ 660.979240] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_rules [ 660.979351] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_members [ 660.979490] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53104c72-b23b-4abf-abf0-b804e8530ce8 with Priority: HIGHEST for action port [ 660.979723] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.979857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.979908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.980218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.980306] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.981299] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.981374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.981416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.981999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.981999] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.981999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.981999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.981999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.982493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.982493] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.982946] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-53104c72-b23b-4abf-abf0-b804e8530ce8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.983699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.983699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.983699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.983699] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53104c72-b23b-4abf-abf0-b804e8530ce8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.028430] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79c30290-ba80-4936-8673-39beeb72a136: rpc.has_security_group_logging(os_id): False [ 661.051469] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.051469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.051469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.052963] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.052963] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.052963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.053515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.053515] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.053515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.053515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.053515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.053687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.053687] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 661.120855] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: SUCCESS [ 661.121112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.121701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.121933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.122155] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.122276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.122338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.122496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.122578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.122690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.122784] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.124684] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.124760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.124884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.125145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.125243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.140613] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 661.313036] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.313036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.313348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.313348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.313453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.313561] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249a08f6-89c5-47f1-a97f-1184bef7140e already deleted. [ 661.313663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.485246] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.486576] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.486576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.486771] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53104c72-b23b-4abf-abf0-b804e8530ce8 with status ACTIVE [ 661.486873] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.486988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.487059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.487313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.487377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.488162] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.488162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.488162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.488162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.488162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.489105] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.489105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.489105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.489105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.489322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.489322] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53104c72-b23b-4abf-abf0-b804e8530ce8 is going to be updated. [ 661.513113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.513113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.513113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.513113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.513113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.513113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53104c72-b23b-4abf-abf0-b804e8530ce8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.628194] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.896222] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 661.896441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.903227] env[65446]: INFO networking_nsxv3.common.synchronization [req-55005fa2-558b-4adf-9fd2-0565a7d827de req-b3c58fde-5ca9-4580-a593-309573344d5d tempest-ServerDiagnosticsTest-899477958 tempest-ServerDiagnosticsTest-899477958-project-member] Enqueued Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_members [ 661.904331] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_members [ 661.904331] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.904645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.904645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.904740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.905216] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.905216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.905216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.905521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.905521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.905599] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.991339] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.132621] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73f89999-ebe2-4491-b7a9-a88502cfe139: rpc.has_security_group_logging(os_id): False [ 662.166790] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.166955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.167335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.167612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.167735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.168074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.168262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.168351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.168635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.168784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.168923] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 is going to be created. [ 662.262428] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.262648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.262742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.263056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.263325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.288689] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: IN_PROGRESS for 2s [ 662.408103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.410436] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.410436] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 already deleted. [ 662.410436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.494858] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.494858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.494858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.495184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.495253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.495398] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c is going to be created. [ 662.528518] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.528518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.528518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.528518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.528518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.539645] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c in Status: UNINITIALIZED for 2s [ 662.617882] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.617882] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.617882] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.618383] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.618794] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.619135] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.622044] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.622044] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.622044] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.622044] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.622044] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.622044] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.622044] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.622044] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.622044] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.622044] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.647688] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.648146] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.648429] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.648783] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.649562] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-6e5ef722-d632-4557-b03d-441d71b921c0 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.650032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.650318] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.650750] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.650993] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e5ef722-d632-4557-b03d-441d71b921c0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.153846] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.156182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.156182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.156496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.156496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.156763] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 6e5ef722-d632-4557-b03d-441d71b921c0 not found, creating... [ 663.157715] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.157715] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.157715] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.157715] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.157715] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.158235] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.158235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.158235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.158430] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.158536] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.158665] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 6e5ef722-d632-4557-b03d-441d71b921c0 is going to be created. [ 663.160996] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 663.161214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.189039] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.189597] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.189801] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.190379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.190753] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.191595] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.566451] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9ef690fb-9a09-4409-9b6d-727aa5ed5f3b None None] Enqueued Resource ID: b7a7dd04-dda7-4c37-a967-daf01f332b5f with Priority: HIGHEST for action port [ 663.567053] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7a7dd04-dda7-4c37-a967-daf01f332b5f with Priority: HIGHEST for action port [ 663.567422] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7a7dd04-dda7-4c37-a967-daf01f332b5f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.567609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7a7dd04-dda7-4c37-a967-daf01f332b5f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.567609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7a7dd04-dda7-4c37-a967-daf01f332b5f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.567870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7a7dd04-dda7-4c37-a967-daf01f332b5f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.567955] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a7dd04-dda7-4c37-a967-daf01f332b5f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.904948] env[65446]: INFO networking_nsxv3.common.synchronization [req-55005fa2-558b-4adf-9fd2-0565a7d827de req-c0a403ae-a6df-47ae-83b5-a6c832e7f107 service nova] Enqueued Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_rules [ 663.905328] env[65446]: INFO networking_nsxv3.common.synchronization [req-55005fa2-558b-4adf-9fd2-0565a7d827de req-c0a403ae-a6df-47ae-83b5-a6c832e7f107 service nova] Enqueued Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_members [ 663.905518] env[65446]: INFO networking_nsxv3.common.synchronization [req-55005fa2-558b-4adf-9fd2-0565a7d827de req-c0a403ae-a6df-47ae-83b5-a6c832e7f107 service nova] Enqueued Resource ID: 6e5ef722-d632-4557-b03d-441d71b921c0 with Priority: HIGHEST for action port [ 663.906445] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_rules [ 663.906636] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_members [ 663.906727] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e5ef722-d632-4557-b03d-441d71b921c0 with Priority: HIGHEST for action port [ 663.907225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.907354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.907684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.908046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.908141] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.910064] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.910203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.910272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.910732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.910847] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.911683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.911683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.911683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.911683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.911846] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.912736] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e5ef722-d632-4557-b03d-441d71b921c0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.912887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.912887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.913088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.913516] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e5ef722-d632-4557-b03d-441d71b921c0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.072077] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7a7dd04-dda7-4c37-a967-daf01f332b5f [ 664.072077] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.072077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.072077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.072077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.072077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.072077] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7a7dd04-dda7-4c37-a967-daf01f332b5f already deleted. [ 664.072077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7a7dd04-dda7-4c37-a967-daf01f332b5f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.310875] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: SUCCESS [ 664.311235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.411655] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.411655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.416782] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e5ef722-d632-4557-b03d-441d71b921c0 with status ACTIVE [ 664.417298] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.419790] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.419790] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.419790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.419790] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e5ef722-d632-4557-b03d-441d71b921c0 is going to be updated. [ 664.424108] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.452104] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.452104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.452406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.452725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.452980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.454957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e5ef722-d632-4557-b03d-441d71b921c0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.496759] env[65446]: INFO networking_nsxv3.common.synchronization [None req-feab3abe-12ef-4eb0-a811-f955002976b2 None None] Enqueued Resource ID: fdf0eff2-0d87-4620-a775-28c57c0c3d3d with Priority: HIGHEST for action port [ 664.497486] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf0eff2-0d87-4620-a775-28c57c0c3d3d with Priority: HIGHEST for action port [ 664.497962] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdf0eff2-0d87-4620-a775-28c57c0c3d3d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.498141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdf0eff2-0d87-4620-a775-28c57c0c3d3d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.498252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdf0eff2-0d87-4620-a775-28c57c0c3d3d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.498585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdf0eff2-0d87-4620-a775-28c57c0c3d3d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.498664] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf0eff2-0d87-4620-a775-28c57c0c3d3d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.556258] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c in Status: SUCCESS [ 664.556484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.556657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.556877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.557119] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.557237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.558467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.558467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.558467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.558467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.558467] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.924650] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.003314] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdf0eff2-0d87-4620-a775-28c57c0c3d3d [ 665.003545] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.003676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.003741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.003950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.004049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.004145] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdf0eff2-0d87-4620-a775-28c57c0c3d3d already deleted. [ 665.004222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdf0eff2-0d87-4620-a775-28c57c0c3d3d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.067898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.067898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.067898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.067898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.067898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.068731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.068731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.068731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.068731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.068731] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.430220] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.430556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.430556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.430810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.430810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.431018] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 is going to be created. [ 665.457434] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.457537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.457537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.458135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.458135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.471853] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 in Status: UNINITIALIZED for 2s [ 665.480927] env[65446]: INFO networking_nsxv3.common.synchronization [req-e1806ade-d3cb-4b04-ba76-ebebc8236ab2 req-a1db6005-42ab-424e-9a61-57b3163772a1 tempest-ListImageFiltersTestJSON-2060955957 tempest-ListImageFiltersTestJSON-2060955957-project-member] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 665.481458] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 665.482391] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.482518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.482909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.483079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.483699] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.483802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.483859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.484092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.484848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.485022] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.572736] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dac699f2-0301-418f-ba2d-7f4d7e342f4c: rpc.has_security_group_logging(os_id): False [ 665.592202] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.592505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.592643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.593090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.596026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.596026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.596026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.596026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.597237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.597237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.597237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c is going to be created. [ 665.697520] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.697520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.697520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.697520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.697520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.710329] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c in Status: IN_PROGRESS for 2s [ 665.988692] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.988951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.988951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.989160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.989264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.989464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.989586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.989650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.989802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.989892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.989975] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 already deleted. [ 665.990064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.107784] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.108400] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.108781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.109583] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.109989] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.110485] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.110485] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.110776] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.110995] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.111337] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.111487] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.111617] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.111727] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.111842] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.112201] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.112201] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.130970] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.130970] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.131202] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.132027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.132027] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-14793060-ffee-4ba3-bc21-70faeb14b886 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.132027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.132027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.132347] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.132347] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14793060-ffee-4ba3-bc21-70faeb14b886',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.148559] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7ae11c19-ef41-4b75-b18a-884d1293cc5d None None] Enqueued Resource ID: d922bebe-33af-4f60-bdd8-ee596353bc57 with Priority: HIGHEST for action port [ 666.148559] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d922bebe-33af-4f60-bdd8-ee596353bc57 with Priority: HIGHEST for action port [ 666.148559] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d922bebe-33af-4f60-bdd8-ee596353bc57 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.148559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d922bebe-33af-4f60-bdd8-ee596353bc57" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.148559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d922bebe-33af-4f60-bdd8-ee596353bc57" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.148983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d922bebe-33af-4f60-bdd8-ee596353bc57" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.148983] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d922bebe-33af-4f60-bdd8-ee596353bc57',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.535645] env[65446]: INFO networking_nsxv3.common.synchronization [None req-3b47c367-e310-4bc5-9ca3-14ea902a5226 None None] Enqueued Resource ID: d0b55a59-10a8-4968-8399-b1f8bfc93fcc with Priority: HIGHEST for action port [ 666.536423] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b55a59-10a8-4968-8399-b1f8bfc93fcc with Priority: HIGHEST for action port [ 666.536778] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0b55a59-10a8-4968-8399-b1f8bfc93fcc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.536910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0b55a59-10a8-4968-8399-b1f8bfc93fcc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.536979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0b55a59-10a8-4968-8399-b1f8bfc93fcc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.537413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0b55a59-10a8-4968-8399-b1f8bfc93fcc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.537518] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0b55a59-10a8-4968-8399-b1f8bfc93fcc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.636020] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.636284] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.636413] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.636685] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.636831] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.637183] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 14793060-ffee-4ba3-bc21-70faeb14b886 not found, creating... [ 666.638452] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.638452] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.638452] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.638452] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.638909] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.639272] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.639440] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.639557] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.640268] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.640415] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.640556] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 14793060-ffee-4ba3-bc21-70faeb14b886 is going to be created. [ 666.652588] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d922bebe-33af-4f60-bdd8-ee596353bc57 [ 666.652588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.652839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.652839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.652940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.653035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.653137] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d922bebe-33af-4f60-bdd8-ee596353bc57 already deleted. [ 666.653220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d922bebe-33af-4f60-bdd8-ee596353bc57" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.662173] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.662377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.662494] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.662742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.663089] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.663369] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.043219] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0b55a59-10a8-4968-8399-b1f8bfc93fcc [ 667.043219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.043219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.043219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.043219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.043219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.043219] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0b55a59-10a8-4968-8399-b1f8bfc93fcc already deleted. [ 667.043219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0b55a59-10a8-4968-8399-b1f8bfc93fcc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.269789] env[65446]: INFO networking_nsxv3.common.synchronization [None req-fcc4e2a6-ae96-42e9-b270-47391ebb5629 None None] Enqueued Resource ID: 1aeb6835-1828-4114-b356-c6aca18e3de0 with Priority: HIGHEST for action port [ 667.270376] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aeb6835-1828-4114-b356-c6aca18e3de0 with Priority: HIGHEST for action port [ 667.270708] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aeb6835-1828-4114-b356-c6aca18e3de0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.270838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aeb6835-1828-4114-b356-c6aca18e3de0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.270908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aeb6835-1828-4114-b356-c6aca18e3de0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.274524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aeb6835-1828-4114-b356-c6aca18e3de0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.277346] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aeb6835-1828-4114-b356-c6aca18e3de0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.461044] env[65446]: INFO networking_nsxv3.common.synchronization [req-e1806ade-d3cb-4b04-ba76-ebebc8236ab2 req-d598f9c8-9e1a-4d1a-9f6c-1d60381ae187 service nova] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_rules [ 667.461239] env[65446]: INFO networking_nsxv3.common.synchronization [req-e1806ade-d3cb-4b04-ba76-ebebc8236ab2 req-d598f9c8-9e1a-4d1a-9f6c-1d60381ae187 service nova] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 667.461412] env[65446]: INFO networking_nsxv3.common.synchronization [req-e1806ade-d3cb-4b04-ba76-ebebc8236ab2 req-d598f9c8-9e1a-4d1a-9f6c-1d60381ae187 service nova] Enqueued Resource ID: 14793060-ffee-4ba3-bc21-70faeb14b886 with Priority: HIGHEST for action port [ 667.462026] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_rules [ 667.462338] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 667.462448] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14793060-ffee-4ba3-bc21-70faeb14b886 with Priority: HIGHEST for action port [ 667.462941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.463117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.463230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.463616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.463762] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.467644] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.467644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.467644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.468027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.468027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.468142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.468142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.468286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.468353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.468446] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.469540] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-14793060-ffee-4ba3-bc21-70faeb14b886 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.469717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.469799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.469983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.470084] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14793060-ffee-4ba3-bc21-70faeb14b886',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.497105] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 in Status: SUCCESS [ 667.497408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.498151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.498394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.498606] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.498810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.498810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.499031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.499088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.499176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.499267] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.725312] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c in Status: SUCCESS [ 667.725616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.779424] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aeb6835-1828-4114-b356-c6aca18e3de0 [ 667.779424] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.779424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.779424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.779424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.779424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.779424] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aeb6835-1828-4114-b356-c6aca18e3de0 already deleted. [ 667.779424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aeb6835-1828-4114-b356-c6aca18e3de0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.931335] env[65446]: INFO networking_nsxv3.common.synchronization [req-cf7b4a00-f609-44dc-9008-b2e2da12c6a0 req-64ac5d8d-33cf-42a1-8774-9cbd4ad1f96f tempest-SecurityGroupRulesTestJSON-1365411131 tempest-SecurityGroupRulesTestJSON-1365411131-project-member] Enqueued Resource ID: 249a08f6-89c5-47f1-a97f-1184bef7140e with Priority: HIGHEST for action security_group_rules [ 667.931856] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249a08f6-89c5-47f1-a97f-1184bef7140e with Priority: HIGHEST for action security_group_rules [ 667.933070] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249a08f6-89c5-47f1-a97f-1184bef7140e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.933070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.933070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.933070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.933070] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249a08f6-89c5-47f1-a97f-1184bef7140e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.968486] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.968486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.983380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14793060-ffee-4ba3-bc21-70faeb14b886 with status ACTIVE [ 667.983762] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.984032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.984120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.984561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.984561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.984850] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.985028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.985104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.985328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.985432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.985688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.985926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.985926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.989050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.989050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.989050] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14793060-ffee-4ba3-bc21-70faeb14b886 is going to be updated. [ 667.992869] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.001253] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.003077] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.003077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.003547] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.003745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.006078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.007296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.007569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.007882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.008108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.010019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.010019] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.022242] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.022242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.022242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.022242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.022242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.022242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14793060-ffee-4ba3-bc21-70faeb14b886" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.457067] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.457272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.457322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.458296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.458296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.458296] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249a08f6-89c5-47f1-a97f-1184bef7140e already deleted. [ 668.458296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.496954] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.512020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18e18b6c-e111-41c0-8a96-bef49fe17675: rpc.has_security_group_logging(os_id): False [ 668.531370] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.531514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.531760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.531839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.531881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.532112] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.532314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.532314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.532456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.532496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.532665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.532753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.532825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.532983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.533064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.533240] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.533329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.533385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.534094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.534192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.534316] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 is going to be created. [ 668.619049] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.619307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.619394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.619619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.619811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.634334] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 in Status: IN_PROGRESS for 2s [ 668.999821] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.000134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.000134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.000301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.000396] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.000544] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be created. [ 669.031330] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.031593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.031593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.032075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.032075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.045789] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: UNINITIALIZED for 2s [ 669.848081] env[65446]: INFO networking_nsxv3.common.synchronization [None req-8bf41371-26d2-4311-bcd7-97fa21d2b8a2 None None] Enqueued Resource ID: 9adf4df1-8f95-487b-a81c-4eaab00f87a8 with Priority: HIGHEST for action port [ 669.849750] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adf4df1-8f95-487b-a81c-4eaab00f87a8 with Priority: HIGHEST for action port [ 669.850284] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-9adf4df1-8f95-487b-a81c-4eaab00f87a8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.850502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9adf4df1-8f95-487b-a81c-4eaab00f87a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.850502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9adf4df1-8f95-487b-a81c-4eaab00f87a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.850794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9adf4df1-8f95-487b-a81c-4eaab00f87a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.850881] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9adf4df1-8f95-487b-a81c-4eaab00f87a8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.354484] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9adf4df1-8f95-487b-a81c-4eaab00f87a8 [ 670.355540] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.355540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.355721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.355857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.355948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.356082] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9adf4df1-8f95-487b-a81c-4eaab00f87a8 already deleted. [ 670.356192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9adf4df1-8f95-487b-a81c-4eaab00f87a8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.421179] env[65446]: INFO networking_nsxv3.common.synchronization [req-764beda5-47d3-4b39-8ff7-3ea526c3d984 req-f204e251-bb62-48ed-946b-d3110a7c0269 tempest-ListImageFiltersTestJSON-2060955957 tempest-ListImageFiltersTestJSON-2060955957-project-member] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 670.422106] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 670.422444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.422572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.652345] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 in Status: SUCCESS [ 670.652513] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.059451] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: SUCCESS [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.062201] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.062201] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.062201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.064319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.064625] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.064857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.065052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.065502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.068206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.068206] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.473386] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.473684] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.475549] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.476552] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.476552] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.476552] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.476552] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.476980] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.477212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.477659] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.477659] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.477782] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.477890] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.478050] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.478200] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.478697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.650022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.650022] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.170 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.650022] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.650022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.650022] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.650022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.650022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.650022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.650022] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94971ae7-fbc1-4fa3-a9db-db97d4a94bc9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.650986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.651138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.651329] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.902472] env[65446]: INFO networking_nsxv3.common.synchronization [None req-2a7841b9-4280-48e7-aa68-c39f9af86261 None None] Enqueued Resource ID: 239591d5-96c0-4b11-9cc3-c285f26db5ac with Priority: HIGHEST for action port [ 671.903255] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 239591d5-96c0-4b11-9cc3-c285f26db5ac with Priority: HIGHEST for action port [ 671.903255] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-239591d5-96c0-4b11-9cc3-c285f26db5ac taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.903417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-239591d5-96c0-4b11-9cc3-c285f26db5ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.903461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-239591d5-96c0-4b11-9cc3-c285f26db5ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.903903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-239591d5-96c0-4b11-9cc3-c285f26db5ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.903903] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('239591d5-96c0-4b11-9cc3-c285f26db5ac',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.154716] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.155164] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.155387] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.155838] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.156114] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.156328] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 not found, creating... [ 672.156880] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.161375] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.161739] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.162212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.162418] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.162889] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.163349] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.163349] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.163693] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.163872] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.164170] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 is going to be created. [ 672.166873] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.193020] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.193778] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.193778] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.194318] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.196427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.196427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.407445] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 239591d5-96c0-4b11-9cc3-c285f26db5ac [ 672.407681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.407816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.407886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.408212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.408212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.408328] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:239591d5-96c0-4b11-9cc3-c285f26db5ac already deleted. [ 672.408395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-239591d5-96c0-4b11-9cc3-c285f26db5ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.670771] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.671104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.671104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.672026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.672026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.672026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be updated. [ 672.704111] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.704276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.704354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.704550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.704694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.714077] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: IN_PROGRESS for 2s [ 672.734570] env[65446]: INFO networking_nsxv3.common.synchronization [req-764beda5-47d3-4b39-8ff7-3ea526c3d984 req-e77470f9-aaac-46f0-a98f-0b896362f3c6 service nova] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_rules [ 672.734570] env[65446]: INFO networking_nsxv3.common.synchronization [req-764beda5-47d3-4b39-8ff7-3ea526c3d984 req-e77470f9-aaac-46f0-a98f-0b896362f3c6 service nova] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 672.734570] env[65446]: INFO networking_nsxv3.common.synchronization [req-764beda5-47d3-4b39-8ff7-3ea526c3d984 req-e77470f9-aaac-46f0-a98f-0b896362f3c6 service nova] Enqueued Resource ID: 94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 with Priority: HIGHEST for action port [ 672.735527] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_rules [ 672.735650] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 672.735866] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 with Priority: HIGHEST for action port [ 672.736016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.736353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.736693] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.736797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.736984] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.737124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.737222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.737846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.737846] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94971ae7-fbc1-4fa3-a9db-db97d4a94bc9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.240429] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 with status ACTIVE [ 673.240857] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.241326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.241475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.241794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.241945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.243453] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.243453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.243453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.243453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.243453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.243810] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.243865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.243936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.244114] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.244198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.244298] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94971ae7-fbc1-4fa3-a9db-db97d4a94bc9 is going to be updated. [ 673.269539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.270313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.270461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.272301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.275081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.275081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94971ae7-fbc1-4fa3-a9db-db97d4a94bc9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.728579] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: SUCCESS [ 674.729227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.729767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.729975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.730216] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.730341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.730455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.730642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.730729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.730815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.730982] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.731965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.731965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.732164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.732374] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.732374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.732501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.732557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.732631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.732712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.732800] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.737438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.738413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.738603] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.738717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.738840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.738999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.738999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.739121] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.172041] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9953ac9d-6c81-42be-ab52-30334261dd73 None None] Enqueued Resource ID: 55b4d897-0b89-4156-9f21-2deea0b82a54 with Priority: HIGHEST for action port [ 675.172328] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b4d897-0b89-4156-9f21-2deea0b82a54 with Priority: HIGHEST for action port [ 675.175935] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-55b4d897-0b89-4156-9f21-2deea0b82a54 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.175935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55b4d897-0b89-4156-9f21-2deea0b82a54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.175935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55b4d897-0b89-4156-9f21-2deea0b82a54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.175935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55b4d897-0b89-4156-9f21-2deea0b82a54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.175935] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55b4d897-0b89-4156-9f21-2deea0b82a54',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.243030] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0365110-9ded-49bd-a10e-2a106e2db350: rpc.has_security_group_logging(os_id): False [ 675.243030] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.263941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.263941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.263941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.263941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.263941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.263941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.264993] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.264993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.264993] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.265472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.265472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.265472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.265472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.265472] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be created. [ 675.327838] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.328018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.328130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.328301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.328477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.343496] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: IN_PROGRESS for 2s [ 675.499444] env[65446]: INFO networking_nsxv3.common.synchronization [None req-cb774a7d-ef1a-4cfc-9d2b-188f373795d2 None None] Enqueued Resource ID: c0932a9a-6bde-464b-a650-20faa655b774 with Priority: HIGHEST for action port [ 675.499870] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0932a9a-6bde-464b-a650-20faa655b774 with Priority: HIGHEST for action port [ 675.500188] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0932a9a-6bde-464b-a650-20faa655b774 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.500311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0932a9a-6bde-464b-a650-20faa655b774" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.500378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0932a9a-6bde-464b-a650-20faa655b774" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.500658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0932a9a-6bde-464b-a650-20faa655b774" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.500703] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0932a9a-6bde-464b-a650-20faa655b774',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.678972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55b4d897-0b89-4156-9f21-2deea0b82a54 [ 675.678972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.678972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.678972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.678972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.678972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.678972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55b4d897-0b89-4156-9f21-2deea0b82a54 already deleted. [ 675.678972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55b4d897-0b89-4156-9f21-2deea0b82a54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.744651] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.003614] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0932a9a-6bde-464b-a650-20faa655b774 [ 676.003770] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.003895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.004018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.004660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.004768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.004886] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0932a9a-6bde-464b-a650-20faa655b774 already deleted. [ 676.004971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0932a9a-6bde-464b-a650-20faa655b774" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.249864] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.250027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.250099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.250328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.250417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.250515] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be updated. [ 676.286729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.286729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.286729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.286729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.286729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.298952] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: IN_PROGRESS for 2s [ 677.360527] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: SUCCESS [ 677.360527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.360527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.360527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.360527] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.864065] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.864237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.000116] env[65446]: INFO networking_nsxv3.common.synchronization [req-d14b45aa-ebf9-4bd4-a25a-036ce2a5a1c9 req-7d78de45-0b88-4b17-914d-b34fb35c9d0d tempest-ListServersNegativeTestJSON-366548564 tempest-ListServersNegativeTestJSON-366548564-project-member] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 678.000675] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 678.000983] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.001121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.001188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.001399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.001916] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.002034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.002094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.002257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.002345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.002442] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.203454] env[65446]: INFO networking_nsxv3.common.synchronization [None req-3d916f97-900b-48ce-8ef5-6c1c2c1c7a44 None None] Enqueued Resource ID: 787c425c-da56-4c48-aaf7-64b6267c9cfb with Priority: HIGHEST for action port [ 678.204209] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787c425c-da56-4c48-aaf7-64b6267c9cfb with Priority: HIGHEST for action port [ 678.204826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-787c425c-da56-4c48-aaf7-64b6267c9cfb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.204946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-787c425c-da56-4c48-aaf7-64b6267c9cfb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.205219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-787c425c-da56-4c48-aaf7-64b6267c9cfb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.205897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-787c425c-da56-4c48-aaf7-64b6267c9cfb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.206064] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('787c425c-da56-4c48-aaf7-64b6267c9cfb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.321301] env[65446]: INFO networking_nsxv3.common.synchronization [req-555426bb-091b-4769-87f2-40f1fe4e246a req-ed736cad-6993-42d6-9f87-4f7699e2918e tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 678.325081] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: SUCCESS [ 678.325081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.325081] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 678.325081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.325442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.325610] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.325807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.325912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.326272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.326408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.326539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.326700] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.327948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.328635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.328757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.328997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.329851] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.330025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.330098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.332078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.332175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.332274] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.505067] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.524653] env[65446]: INFO networking_nsxv3.common.synchronization [req-58a13e06-080a-4d30-8a6d-3eafdc1f68d3 req-843b797a-e1fa-4061-b905-bc921a8abc1e tempest-DeleteServersAdminTestJSON-331057081 tempest-DeleteServersAdminTestJSON-331057081-project-member] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 678.525399] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGHEST for action security_group_members [ 678.526069] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.526189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.526239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.526436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.526671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.527208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.527282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.527521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.527629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.527725] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.709109] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 787c425c-da56-4c48-aaf7-64b6267c9cfb [ 678.709492] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.709641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.709641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.709855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.710613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.710613] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:787c425c-da56-4c48-aaf7-64b6267c9cfb already deleted. [ 678.710613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-787c425c-da56-4c48-aaf7-64b6267c9cfb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.835729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.838360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.838360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.838360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.838360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.839240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.839240] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.839240] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.008131] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.030102] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.030102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.030102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.030368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.030531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.030786] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.030950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.031039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.031337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.031337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.031463] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be updated. [ 679.068089] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.068089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.068089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.068089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.068089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.079811] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: IN_PROGRESS for 2s [ 679.341160] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0365110-9ded-49bd-a10e-2a106e2db350: rpc.has_security_group_logging(os_id): False [ 679.343901] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.369999] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.370720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.370720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.370720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.370720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.371121] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.371268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.371414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.371514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.371623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.371878] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.372035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.372122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.372258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.372339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.372565] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.372721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.372721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.372858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.373130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.373130] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be updated. [ 679.462527] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.462527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.462987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.462987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.462987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.479776] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: IN_PROGRESS for 2s [ 679.513317] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.513659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.513659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.513971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.514078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.514211] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 679.544840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.544840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.544840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.545045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.545271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.557561] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 679.582145] env[65446]: INFO networking_nsxv3.common.synchronization [req-01a78cfe-b88a-4c1b-8a00-a9c9819e39c8 req-fc463b60-94ba-44d9-ac34-97488baee180 tempest-SecurityGroupRulesTestJSON-1365411131 tempest-SecurityGroupRulesTestJSON-1365411131-project-member] Enqueued Resource ID: 249a08f6-89c5-47f1-a97f-1184bef7140e with Priority: HIGHEST for action security_group_rules [ 679.582340] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249a08f6-89c5-47f1-a97f-1184bef7140e with Priority: HIGHEST for action security_group_rules [ 679.582645] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249a08f6-89c5-47f1-a97f-1184bef7140e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.582766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.582831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.583270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.583370] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249a08f6-89c5-47f1-a97f-1184bef7140e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.631226] env[65446]: INFO networking_nsxv3.common.synchronization [req-edb5f656-ba28-4870-ac5d-062e3ca856d7 req-54ab83b2-2d45-4284-bf50-de87b5286749 tempest-ServersAdminNegativeTestJSON-1179735760 tempest-ServersAdminNegativeTestJSON-1179735760-project-member] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 679.631983] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 679.632734] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.632734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.633096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.633793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.633793] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.633793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.633793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.634125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.634125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.634248] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.850514] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.850674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.850816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.850959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.851185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.851185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 679.882563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.882827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.882827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.883088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.883220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.895696] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 680.107486] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.107691] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.107809] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.108101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.108378] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.108800] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.108800] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.109829] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.109985] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.110207] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.110320] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.110423] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.110529] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.110630] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.110729] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.110852] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.117818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.117818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.118025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.118258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.118374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.118479] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249a08f6-89c5-47f1-a97f-1184bef7140e already deleted. [ 680.118563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249a08f6-89c5-47f1-a97f-1184bef7140e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.135727] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.135942] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.136018] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.136469] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.136591] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-a9444e0f-6b78-490f-b030-2905054d75ab taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.136687] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.136801] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.137158] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.137298] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9444e0f-6b78-490f-b030-2905054d75ab',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.138462] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.388067] env[65446]: INFO networking_nsxv3.common.synchronization [None req-8b9f4ce3-ec9e-4227-bfc9-cf55122b753f None None] Enqueued Resource ID: 879dd544-bcd8-4024-8690-cf07d0e391b1 with Priority: HIGHEST for action port [ 680.388398] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879dd544-bcd8-4024-8690-cf07d0e391b1 with Priority: HIGHEST for action port [ 680.390080] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-879dd544-bcd8-4024-8690-cf07d0e391b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.390216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-879dd544-bcd8-4024-8690-cf07d0e391b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.390289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-879dd544-bcd8-4024-8690-cf07d0e391b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.390541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-879dd544-bcd8-4024-8690-cf07d0e391b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.390625] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('879dd544-bcd8-4024-8690-cf07d0e391b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.641419] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.641782] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.641782] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.641937] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.642091] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.642244] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port a9444e0f-6b78-490f-b030-2905054d75ab not found, creating... [ 680.642500] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.642648] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.642760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.642968] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.643115] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.643385] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.643530] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.643641] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.643838] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.643963] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.644128] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: a9444e0f-6b78-490f-b030-2905054d75ab is going to be created. [ 680.645231] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.665514] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.665907] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.665907] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.666171] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.666402] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.666618] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.895848] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 879dd544-bcd8-4024-8690-cf07d0e391b1 [ 680.896187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.896372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.896372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.896664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.896664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.896836] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:879dd544-bcd8-4024-8690-cf07d0e391b1 already deleted. [ 680.896836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-879dd544-bcd8-4024-8690-cf07d0e391b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.923229] env[65446]: INFO networking_nsxv3.common.synchronization [None req-fe0493e4-4343-454b-bbcf-e36c535f53e8 None None] Enqueued Resource ID: 2912bb69-118a-4007-9c74-d1e0b3040489 with Priority: HIGHEST for action port [ 680.923229] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2912bb69-118a-4007-9c74-d1e0b3040489 with Priority: HIGHEST for action port [ 680.923229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2912bb69-118a-4007-9c74-d1e0b3040489 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.923229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2912bb69-118a-4007-9c74-d1e0b3040489" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.923229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2912bb69-118a-4007-9c74-d1e0b3040489" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.924180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2912bb69-118a-4007-9c74-d1e0b3040489" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.924285] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2912bb69-118a-4007-9c74-d1e0b3040489',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.092567] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 in Status: SUCCESS [ 681.092777] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 deletion is rescheduled due to dependency. [ 681.092923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.151202] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.151202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.151202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.151202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.151202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.151202] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be updated. [ 681.181557] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.182080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.182080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.182080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.182236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.192721] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: IN_PROGRESS for 2s [ 681.364946] env[65446]: INFO networking_nsxv3.common.synchronization [None req-0360e1ec-def7-41ad-ac04-6f10aa69a0d5 None None] Enqueued Resource ID: ed5afac1-ccba-4d2a-8042-2637fb71dab2 with Priority: HIGHEST for action port [ 681.365394] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5afac1-ccba-4d2a-8042-2637fb71dab2 with Priority: HIGHEST for action port [ 681.365907] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed5afac1-ccba-4d2a-8042-2637fb71dab2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.367137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed5afac1-ccba-4d2a-8042-2637fb71dab2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.367137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed5afac1-ccba-4d2a-8042-2637fb71dab2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.368947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed5afac1-ccba-4d2a-8042-2637fb71dab2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.368947] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed5afac1-ccba-4d2a-8042-2637fb71dab2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.429112] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2912bb69-118a-4007-9c74-d1e0b3040489 [ 681.429934] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.429934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.429934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.429934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.429934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.429934] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2912bb69-118a-4007-9c74-d1e0b3040489 already deleted. [ 681.429934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2912bb69-118a-4007-9c74-d1e0b3040489" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.466073] env[65446]: INFO networking_nsxv3.common.synchronization [req-edb5f656-ba28-4870-ac5d-062e3ca856d7 req-1acfcbd2-7821-4083-b189-52646dd91590 service nova] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_rules [ 681.466073] env[65446]: INFO networking_nsxv3.common.synchronization [req-edb5f656-ba28-4870-ac5d-062e3ca856d7 req-1acfcbd2-7821-4083-b189-52646dd91590 service nova] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 681.466073] env[65446]: INFO networking_nsxv3.common.synchronization [req-edb5f656-ba28-4870-ac5d-062e3ca856d7 req-1acfcbd2-7821-4083-b189-52646dd91590 service nova] Enqueued Resource ID: a9444e0f-6b78-490f-b030-2905054d75ab with Priority: HIGHEST for action port [ 681.467018] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_rules [ 681.467018] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 681.467018] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9444e0f-6b78-490f-b030-2905054d75ab with Priority: HIGHEST for action port [ 681.467812] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.467812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.467950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.468281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.468281] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.469234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.470291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.470291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9444e0f-6b78-490f-b030-2905054d75ab taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.470291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.470291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.470291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.470291] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9444e0f-6b78-490f-b030-2905054d75ab',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.495602] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: SUCCESS [ 681.495819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.571419] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 681.571419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.873496] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed5afac1-ccba-4d2a-8042-2637fb71dab2 [ 681.874203] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.874203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.874203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.874397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.874486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.874672] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed5afac1-ccba-4d2a-8042-2637fb71dab2 already deleted. [ 681.874997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed5afac1-ccba-4d2a-8042-2637fb71dab2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.909401] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 681.909668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.972360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.972515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.972726] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9444e0f-6b78-490f-b030-2905054d75ab with status ACTIVE [ 681.972897] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.973022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.973107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.973341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.973431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.973602] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.973694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.973756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.973899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.973972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.974268] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.974335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.974335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.974475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.974557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.974630] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9444e0f-6b78-490f-b030-2905054d75ab is going to be updated. [ 681.997888] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.998112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.998112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.998296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.998410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.998592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9444e0f-6b78-490f-b030-2905054d75ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.590979] env[65446]: INFO networking_nsxv3.common.synchronization [req-2625ed78-0299-4705-bef6-1d14caf3930f req-eb0971af-a952-4dc8-902d-b9ed25d5af62 tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 682.591501] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 682.591869] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.592010] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.592061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.592288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.592461] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.592659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.592659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.592844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.593038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.593205] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.097976] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.098725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.098725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.098725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.098725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.098725] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.098955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.098955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.099059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.099112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.099308] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 683.134530] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.134530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.134530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.134530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.134530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.144428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 683.205913] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: SUCCESS [ 683.206623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.207558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.207558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.207558] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.207558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.207558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.207858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.207858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.207934] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.710523] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.911487] env[65446]: INFO networking_nsxv3.common.synchronization [None req-45cc2c4d-e033-409b-bb9f-0b433c285021 None None] Enqueued Resource ID: 8a897c12-4b78-4492-845d-8677625b23e0 with Priority: HIGHEST for action port [ 683.912166] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a897c12-4b78-4492-845d-8677625b23e0 with Priority: HIGHEST for action port [ 683.912501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a897c12-4b78-4492-845d-8677625b23e0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.912630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a897c12-4b78-4492-845d-8677625b23e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.912693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a897c12-4b78-4492-845d-8677625b23e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.913427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a897c12-4b78-4492-845d-8677625b23e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.913427] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a897c12-4b78-4492-845d-8677625b23e0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.021287] env[65446]: INFO networking_nsxv3.common.synchronization [req-9d1c5914-8ce3-44d3-b65f-abb60ac6db43 req-9e11353d-88ed-4f02-96bc-66df4a838aa9 tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 684.023146] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 684.023484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.023671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.023671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.023870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.024032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.024144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.024233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.024400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.024492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.024586] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.035628] env[65446]: INFO networking_nsxv3.common.synchronization [req-77764b53-0a68-4441-8587-239da2817fb8 req-18f0dfe8-a4ad-4648-8031-2212bdb4c0ed tempest-ServersTestManualDisk-1783414972 tempest-ServersTestManualDisk-1783414972-project-member] Enqueued Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_members [ 684.036179] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGHEST for action security_group_members [ 684.036549] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.036723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.036809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.037030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.038227] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.038227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.038227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.038227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.038227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.038227] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.214601] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.415486] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a897c12-4b78-4492-845d-8677625b23e0 [ 684.415728] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.415885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.415977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.416361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.419266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.419639] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a897c12-4b78-4492-845d-8677625b23e0 already deleted. [ 684.419639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a897c12-4b78-4492-845d-8677625b23e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.529526] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.529709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.529755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.530451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.530451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.530451] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.530451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.530451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.531031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.531031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.531031] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 684.540204] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.540387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.540474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.540760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.540901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.541173] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.541302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.541384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.541578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.541673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.541792] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 is going to be updated. [ 684.578235] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.578583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.578675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.578898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.579054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.585343] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.585343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.585588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.585667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.585803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.595259] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 684.597838] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 in Status: IN_PROGRESS for 2s [ 684.664876] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.664876] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.664876] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.665306] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.665658] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.665882] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.666438] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.666528] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.667194] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.667194] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.667194] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.667194] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.667478] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.667535] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.667703] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.667890] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.691438] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.691918] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.691918] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.692098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.692431] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-15e38e83-0c8b-49af-a8eb-addd4d365ee5 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.692609] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.692744] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.693409] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.693409] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15e38e83-0c8b-49af-a8eb-addd4d365ee5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.718691] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.718935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.719752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.720095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.720212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.720325] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be updated. [ 684.759038] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.759038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.759038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.759038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.759038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.769206] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: IN_PROGRESS for 2s [ 685.155448] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 685.155556] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 deletion is rescheduled due to dependency. [ 685.155679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.196187] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.196643] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.196643] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.197547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.197547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.197547] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 15e38e83-0c8b-49af-a8eb-addd4d365ee5 not found, creating... [ 685.197547] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.198072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.198072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.198072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.198204] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.198402] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.199035] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.199035] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.199240] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.199240] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.199371] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 15e38e83-0c8b-49af-a8eb-addd4d365ee5 is going to be created. [ 685.236364] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.236364] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.236364] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.236364] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.236364] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.236364] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.069889] env[65446]: INFO networking_nsxv3.common.synchronization [req-9d1c5914-8ce3-44d3-b65f-abb60ac6db43 req-7771b3b5-ad2c-44a5-9019-0cb7f7beaf6c service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 686.070105] env[65446]: INFO networking_nsxv3.common.synchronization [req-9d1c5914-8ce3-44d3-b65f-abb60ac6db43 req-7771b3b5-ad2c-44a5-9019-0cb7f7beaf6c service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 686.070341] env[65446]: INFO networking_nsxv3.common.synchronization [req-9d1c5914-8ce3-44d3-b65f-abb60ac6db43 req-7771b3b5-ad2c-44a5-9019-0cb7f7beaf6c service nova] Enqueued Resource ID: 15e38e83-0c8b-49af-a8eb-addd4d365ee5 with Priority: HIGHEST for action port [ 686.071047] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 686.071341] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 686.071341] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e38e83-0c8b-49af-a8eb-addd4d365ee5 with Priority: HIGHEST for action port [ 686.071680] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.071838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.071888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.072191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.072281] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.073305] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.073408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.073602] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-15e38e83-0c8b-49af-a8eb-addd4d365ee5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.073710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.073807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.074046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.074128] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15e38e83-0c8b-49af-a8eb-addd4d365ee5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.421446] env[65446]: INFO networking_nsxv3.common.synchronization [req-89a4c681-ae8a-4230-b2d6-01b9fc45d087 req-d4e3c6ba-4244-49a7-bc3f-1230317bf324 tempest-ServerDiagnosticsTest-899477958 tempest-ServerDiagnosticsTest-899477958-project-member] Enqueued Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_members [ 686.422400] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGHEST for action security_group_members [ 686.422400] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.422400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.422615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.422615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.422768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.423844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.423844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.423844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.423844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.423844] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.577483] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.577615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.581326] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15e38e83-0c8b-49af-a8eb-addd4d365ee5 with status ACTIVE [ 686.581326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.581326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.581326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.581326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.581326] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15e38e83-0c8b-49af-a8eb-addd4d365ee5 is going to be updated. [ 686.605329] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 686.605509] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 686.605682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.605776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.606257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.606450] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.606566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.606628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.606790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.606870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.606965] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.610463] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.610608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.610673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.610849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.610980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.611175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15e38e83-0c8b-49af-a8eb-addd4d365ee5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.617366] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 in Status: SUCCESS [ 686.617366] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 deletion is rescheduled due to dependency. [ 686.617366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.780928] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: SUCCESS [ 686.781247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.781477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.781788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.781993] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.782303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.782303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.782420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.782459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.782610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.782610] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.868211] env[65446]: INFO networking_nsxv3.common.synchronization [req-03d1ec15-4e78-459d-a707-526f3f2d5f7a req-155e8389-6c86-41a6-bb53-5e862c634ed5 tempest-ServerDiagnosticsNegativeTest-1583363276 tempest-ServerDiagnosticsNegativeTest-1583363276-project-member] Enqueued Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_members [ 686.868431] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_members [ 686.868693] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.868803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.868864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.869144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.869320] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.869973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.870061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.870346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.870451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.870572] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.926774] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.926774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.926774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.926774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.926774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.927340] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.927340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.927340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.927499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.927499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.927584] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 is going to be updated. [ 686.956568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.956760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.956760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.956989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.957201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.967817] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 in Status: IN_PROGRESS for 2s [ 687.112641] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.285555] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.285671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.285735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.285892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.286078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.286202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.286264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.286393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.286483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.286614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.286719] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.286799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.286930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.286986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.287137] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.287246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.287289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.287445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.287589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.287657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.287731] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.302516] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.302745] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.302912] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.303093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.303371] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.303530] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.303639] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.303856] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.304394] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.304394] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.304394] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.304658] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.304658] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.304658] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.304850] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.304850] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.326633] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.327597] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.327963] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.327963] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.328519] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-14af82c9-8115-4366-9c9c-bddf1fbbced8 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.328656] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.328837] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.329171] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.329363] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14af82c9-8115-4366-9c9c-bddf1fbbced8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.374604] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.375010] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.375234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.375557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.375853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.376227] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.376565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.376738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.376997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.377191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.377369] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a0887e-2263-4406-985f-71a50777bccb already deleted. [ 687.378153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.615236] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.791031] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56ef744e-edae-484b-8821-4f332fd192db: rpc.has_security_group_logging(os_id): False [ 687.811657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.811834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.811885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.812108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.812205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.812538] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.812538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.812656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.812700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.812765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.812949] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.813042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.813099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.813236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.813310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.813523] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.813628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.813690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.813827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.813900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.813983] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be updated. [ 687.832080] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.832335] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.832447] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.832752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.832920] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.833072] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 14af82c9-8115-4366-9c9c-bddf1fbbced8 not found, creating... [ 687.833336] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.833509] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.833628] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.833852] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.833986] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.834289] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.834468] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.834584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.834811] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.834967] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.835173] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 14af82c9-8115-4366-9c9c-bddf1fbbced8 is going to be created. [ 687.854915] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.855060] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.861118] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.861118] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.861118] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.861118] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.920195] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.920463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.920463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.920649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.920731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.940754] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: IN_PROGRESS for 2s [ 688.122559] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.122559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.122559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.122559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.122559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.122559] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 688.155030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.155208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.155340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.155646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.156254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.165485] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 688.586135] env[65446]: INFO networking_nsxv3.common.synchronization [req-03d1ec15-4e78-459d-a707-526f3f2d5f7a req-cfef190f-f701-482a-872c-2aa83523e6b5 service nova] Enqueued Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_rules [ 688.586135] env[65446]: INFO networking_nsxv3.common.synchronization [req-03d1ec15-4e78-459d-a707-526f3f2d5f7a req-cfef190f-f701-482a-872c-2aa83523e6b5 service nova] Enqueued Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_members [ 688.586135] env[65446]: INFO networking_nsxv3.common.synchronization [req-03d1ec15-4e78-459d-a707-526f3f2d5f7a req-cfef190f-f701-482a-872c-2aa83523e6b5 service nova] Enqueued Resource ID: 14af82c9-8115-4366-9c9c-bddf1fbbced8 with Priority: HIGHEST for action port [ 688.586135] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_rules [ 688.586135] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_members [ 688.586135] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14af82c9-8115-4366-9c9c-bddf1fbbced8 with Priority: HIGHEST for action port [ 688.586663] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.586663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.586663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.586663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.586897] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.587775] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.587894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.588020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.588244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.588380] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.588487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.588534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.588687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.589030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.589030] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.592511] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-14af82c9-8115-4366-9c9c-bddf1fbbced8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.592511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.592511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.592730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.592730] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14af82c9-8115-4366-9c9c-bddf1fbbced8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.604642] env[65446]: INFO networking_nsxv3.common.synchronization [req-98dace32-5ccb-4d0d-b219-9d6d7fdefb0f req-95ba974a-3c3d-449c-9ca2-d6edc95d7868 tempest-InstanceActionsNegativeTestJSON-368243182 tempest-InstanceActionsNegativeTestJSON-368243182-project-member] Enqueued Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_members [ 688.605274] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGHEST for action security_group_members [ 688.605633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.605740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.605803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.606015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.606668] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.606828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.606937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.608490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.608490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.608490] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.980132] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 in Status: SUCCESS [ 688.980514] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 deletion is rescheduled due to dependency. [ 688.980514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.096488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.096687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.096883] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.098016] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14af82c9-8115-4366-9c9c-bddf1fbbced8 with status ACTIVE [ 689.098180] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.098356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.098482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.098710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.098905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.099051] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.099196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.099290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.099468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.099667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.099958] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.099958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.099958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.100265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.100265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.100338] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14af82c9-8115-4366-9c9c-bddf1fbbced8 is going to be updated. [ 689.112211] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.113120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.113120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.113120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.113120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.113120] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.113120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.113120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.114369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.114369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.114369] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c is going to be updated. [ 689.126056] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.126263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.126333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.126516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.127037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.127334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14af82c9-8115-4366-9c9c-bddf1fbbced8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.146395] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.146395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.146395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.146395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.146719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.157031] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c in Status: IN_PROGRESS for 2s [ 689.521706] env[65446]: INFO networking_nsxv3.common.synchronization [req-2f05ffbc-dc83-4885-8cc4-d197cdc28b67 req-b941d50c-f527-4b5a-89c3-ecbc27fa4072 tempest-FloatingIPsAssociationNegativeTestJSON-1351588854 tempest-FloatingIPsAssociationNegativeTestJSON-1351588854-project-member] Enqueued Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_members [ 689.522575] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGHEST for action security_group_members [ 689.523730] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.523854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.523920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.524195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.526415] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.526415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.526415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.526415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.526415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.526415] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.603039] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.955242] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: SUCCESS [ 689.955242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.027841] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.027841] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.027841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.027841] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 is going to be updated. [ 690.070187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.070442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.070442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.070619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.070776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.081569] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 in Status: IN_PROGRESS for 2s [ 690.106233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.106400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.106486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.106705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.106806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.106928] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a0887e-2263-4406-985f-71a50777bccb is going to be created. [ 690.146063] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.146063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.146063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.146063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.146063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.157969] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a0887e-2263-4406-985f-71a50777bccb in Status: UNINITIALIZED for 2s [ 690.175413] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 690.176165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.176165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.176325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.176521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.176675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.176726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.176863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.176944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.177051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.177172] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.679354] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.679515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.679595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.679897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.680081] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.680190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.680251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.680406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.680495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.680579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.680723] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.680811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.680882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.681058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.681290] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.681397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.681455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.681597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.681671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.681749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.681839] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.188288] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184: rpc.has_security_group_logging(os_id): False [ 691.190382] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c in Status: SUCCESS [ 691.190658] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c deletion is rescheduled due to dependency. [ 691.190808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.209200] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.209397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.209397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.209683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.209884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.209987] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.210100] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.210183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.210359] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.210439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.210681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.210775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.210861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.211027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.211139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.211343] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.211489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.211561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.211706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.211793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.211894] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 691.276932] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.276932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.276932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.276932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.276932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.292252] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 691.351595] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4a59524e-96f4-4928-8b6c-139bf75c875e tempest-MigrationsAdminTest-1736177509 tempest-MigrationsAdminTest-1736177509-project-member] Enqueued Resource ID: 4c4c755b-047c-4b21-9f75-96f903cf6b17 with Priority: HIGHEST for action security_group_rules [ 691.352517] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4c755b-047c-4b21-9f75-96f903cf6b17 with Priority: HIGHEST for action security_group_rules [ 691.352517] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4c755b-047c-4b21-9f75-96f903cf6b17 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.352688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.352688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.352990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.353158] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4c755b-047c-4b21-9f75-96f903cf6b17',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.564451] env[65446]: INFO networking_nsxv3.common.synchronization [None req-20dbe4c1-4f58-49b2-a52e-eaf6ed4ad57d tempest-MigrationsAdminTest-1736177509 tempest-MigrationsAdminTest-1736177509-project-member] Enqueued Resource ID: 4c4c755b-047c-4b21-9f75-96f903cf6b17 with Priority: HIGHEST for action security_group_rules [ 691.565630] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4c755b-047c-4b21-9f75-96f903cf6b17 with Priority: HIGHEST for action security_group_rules [ 691.565948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4c755b-047c-4b21-9f75-96f903cf6b17 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.566099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.877190] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.877410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.877410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.877646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.877753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.877875] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4c755b-047c-4b21-9f75-96f903cf6b17 already deleted. [ 691.877966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.878238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.878419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.878856] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4c755b-047c-4b21-9f75-96f903cf6b17',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.094200] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 in Status: SUCCESS [ 692.094200] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 deletion is rescheduled due to dependency. [ 692.094200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.170447] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a0887e-2263-4406-985f-71a50777bccb in Status: SUCCESS [ 692.170772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.170901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.171194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.171276] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.171362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.171460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.171624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.171747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.171840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.172363] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.402239] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.402536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.402536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.402673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.402753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.402845] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4c755b-047c-4b21-9f75-96f903cf6b17 already deleted. [ 692.402922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4c755b-047c-4b21-9f75-96f903cf6b17" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.674475] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.674640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.674735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.674963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.675182] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.675650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.675729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.675871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.675960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.676078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.676363] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.676363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.676479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.676524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.676658] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.676735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.676792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.676916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.676992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.677087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.677171] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.180827] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15a0887e-2263-4406-985f-71a50777bccb: rpc.has_security_group_logging(os_id): False [ 693.202085] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.202297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.202919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.202919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.202919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.203113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.203184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.203235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207023] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a0887e-2263-4406-985f-71a50777bccb is going to be created. [ 693.288165] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.288165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.288165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.288365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.288689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.306275] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a0887e-2263-4406-985f-71a50777bccb in Status: IN_PROGRESS for 2s [ 693.308797] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 693.309014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.976616] env[65446]: INFO networking_nsxv3.common.synchronization [None req-aedf6aab-56cf-47c3-905f-65e73bf8a375 None None] Enqueued Resource ID: 07f01519-fe07-4e2e-b853-46c6b400cab6 with Priority: HIGHEST for action port [ 694.977170] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07f01519-fe07-4e2e-b853-46c6b400cab6 with Priority: HIGHEST for action port [ 694.977484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-07f01519-fe07-4e2e-b853-46c6b400cab6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.977621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07f01519-fe07-4e2e-b853-46c6b400cab6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.977698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07f01519-fe07-4e2e-b853-46c6b400cab6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.977937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07f01519-fe07-4e2e-b853-46c6b400cab6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.978191] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07f01519-fe07-4e2e-b853-46c6b400cab6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.121039] env[65446]: INFO networking_nsxv3.common.synchronization [req-cd6454dc-1c0e-4f87-b891-16ceba95e934 req-7b805bd9-0732-4699-8d2f-22039a30590a tempest-ServerPasswordTestJSON-531470353 tempest-ServerPasswordTestJSON-531470353-project-member] Enqueued Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_members [ 695.121384] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_members [ 695.121868] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.122241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.122434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.122772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.123061] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.124357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.124357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.124357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.124357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.124357] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.324193] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a0887e-2263-4406-985f-71a50777bccb in Status: SUCCESS [ 695.324193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.481604] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07f01519-fe07-4e2e-b853-46c6b400cab6 [ 695.481604] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.481604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.481604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.481604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.481604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.481604] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07f01519-fe07-4e2e-b853-46c6b400cab6 already deleted. [ 695.481604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07f01519-fe07-4e2e-b853-46c6b400cab6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.526325] env[65446]: INFO networking_nsxv3.common.synchronization [None req-bdd6014e-8cd0-4bf6-9d98-ca52f5f5fdb2 None None] Enqueued Resource ID: 70c7b441-8514-4d11-8599-15952dfc198e with Priority: HIGHEST for action port [ 695.528593] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c7b441-8514-4d11-8599-15952dfc198e with Priority: HIGHEST for action port [ 695.529259] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-70c7b441-8514-4d11-8599-15952dfc198e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.529259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70c7b441-8514-4d11-8599-15952dfc198e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.529259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70c7b441-8514-4d11-8599-15952dfc198e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.529555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70c7b441-8514-4d11-8599-15952dfc198e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.529681] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70c7b441-8514-4d11-8599-15952dfc198e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.626140] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.627066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.627066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.627066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.627066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.628117] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.628117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.628117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.628117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.628117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.628117] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23716b6-1df0-449b-b54b-5cbfb06165bd already deleted. [ 695.628117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.725307] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-816 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.725307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-816" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.725307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-816" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.725307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-816" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.725307] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.725307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.725307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.727625] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.727625] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.727806] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.727806] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.727931] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.728067] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.728184] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.728288] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.728426] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.751084] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.755045] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.755045] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.755045] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-816" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.755365] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-59705e04-d410-4dc6-af50-8d96ca0922f9 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.755926] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.755926] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.756408] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.756599] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59705e04-d410-4dc6-af50-8d96ca0922f9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.032235] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70c7b441-8514-4d11-8599-15952dfc198e [ 696.032524] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.032524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.032631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.033296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.033296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.033296] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70c7b441-8514-4d11-8599-15952dfc198e already deleted. [ 696.033296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70c7b441-8514-4d11-8599-15952dfc198e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.261146] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.261146] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.261330] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.261694] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.261832] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.261988] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 59705e04-d410-4dc6-af50-8d96ca0922f9 not found, creating... [ 696.262281] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.262446] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.262847] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.262847] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.262964] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.263195] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.263348] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.264032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.264032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.264032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.264032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 59705e04-d410-4dc6-af50-8d96ca0922f9 is going to be created. [ 696.290023] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.291695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.291695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.291695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.291695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.291695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.072901] env[65446]: INFO networking_nsxv3.common.synchronization [req-cd6454dc-1c0e-4f87-b891-16ceba95e934 req-083ceb62-cf37-4828-ab4f-95ec3645b271 service nova] Enqueued Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_rules [ 697.073240] env[65446]: INFO networking_nsxv3.common.synchronization [req-cd6454dc-1c0e-4f87-b891-16ceba95e934 req-083ceb62-cf37-4828-ab4f-95ec3645b271 service nova] Enqueued Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_members [ 697.073404] env[65446]: INFO networking_nsxv3.common.synchronization [req-cd6454dc-1c0e-4f87-b891-16ceba95e934 req-083ceb62-cf37-4828-ab4f-95ec3645b271 service nova] Enqueued Resource ID: 59705e04-d410-4dc6-af50-8d96ca0922f9 with Priority: HIGHEST for action port [ 697.073871] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_rules [ 697.077237] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_members [ 697.077442] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59705e04-d410-4dc6-af50-8d96ca0922f9 with Priority: HIGHEST for action port [ 697.077782] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.078116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.078116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.078416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.078416] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.079475] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.079595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.079660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.079799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.079946] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.080044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.080106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.080241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.080320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.080410] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.082588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-59705e04-d410-4dc6-af50-8d96ca0922f9 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.082588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.082588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.082588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.082588] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59705e04-d410-4dc6-af50-8d96ca0922f9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.398287] env[65446]: INFO networking_nsxv3.common.synchronization [req-f007d662-d662-42d8-bd8e-594e62a51ca7 req-5ddc415a-2915-40c4-9e68-755a452d9c64 tempest-AttachInterfacesV270Test-1119274591 tempest-AttachInterfacesV270Test-1119274591-project-member] Enqueued Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_members [ 697.398887] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_members [ 697.399208] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.399558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.399657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.399910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.400115] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.400234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.400303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.400457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.400502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.400586] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.589070] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.589070] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.589070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.589070] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59705e04-d410-4dc6-af50-8d96ca0922f9 with status ACTIVE [ 697.589070] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.589070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.589070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.592623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.592844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.594607] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.594607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.594607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.594607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.594607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.594607] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.594607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.594607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.594607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.595850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.595850] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59705e04-d410-4dc6-af50-8d96ca0922f9 is going to be updated. [ 697.624538] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.624770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.624857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.625189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.625560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.625642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59705e04-d410-4dc6-af50-8d96ca0922f9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.744820] env[65446]: INFO networking_nsxv3.common.synchronization [None req-6818148a-519e-49f8-af1a-a7d68289fed4 None None] Enqueued Resource ID: d0965590-3c41-47bc-a212-1bc12be7efc7 with Priority: HIGHEST for action port [ 697.745939] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0965590-3c41-47bc-a212-1bc12be7efc7 with Priority: HIGHEST for action port [ 697.745939] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0965590-3c41-47bc-a212-1bc12be7efc7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.746543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0965590-3c41-47bc-a212-1bc12be7efc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.746678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0965590-3c41-47bc-a212-1bc12be7efc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.746972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0965590-3c41-47bc-a212-1bc12be7efc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.747074] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0965590-3c41-47bc-a212-1bc12be7efc7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.852773] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.853023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-780" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.853165] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-780" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.853574] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-780" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.854096] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.855171] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.855596] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.855949] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.856169] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.856488] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.856672] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.856827] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.856995] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.857209] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.857402] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.857899] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.880604] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.880604] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.880760] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.882190] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-780" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.882190] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-13493514-a1ba-4c0b-bd8b-f8428797d35e taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.882190] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.882190] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.882190] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.882190] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13493514-a1ba-4c0b-bd8b-f8428797d35e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.903356] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.903537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.903693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.903818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.903909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.904111] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.904216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.904277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.904418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.904492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.904573] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98940883-9fda-4b23-9149-fb7213985597 already deleted. [ 697.904665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.022485] env[65446]: INFO networking_nsxv3.common.synchronization [None req-33af5342-ae3c-4971-92bd-319ae097a7ae None None] Enqueued Resource ID: c7cd0617-9eb8-4653-99d5-f446d01eeaf9 with Priority: HIGHEST for action port [ 698.022915] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7cd0617-9eb8-4653-99d5-f446d01eeaf9 with Priority: HIGHEST for action port [ 698.023741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7cd0617-9eb8-4653-99d5-f446d01eeaf9 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.023741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7cd0617-9eb8-4653-99d5-f446d01eeaf9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.023741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7cd0617-9eb8-4653-99d5-f446d01eeaf9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.024218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7cd0617-9eb8-4653-99d5-f446d01eeaf9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.024218] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7cd0617-9eb8-4653-99d5-f446d01eeaf9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.098415] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.250441] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0965590-3c41-47bc-a212-1bc12be7efc7 [ 698.250704] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.250844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.250947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.251208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.251307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.251411] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0965590-3c41-47bc-a212-1bc12be7efc7 already deleted. [ 698.251493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0965590-3c41-47bc-a212-1bc12be7efc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.386952] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.387219] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.387359] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.387706] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.387885] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.388051] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 13493514-a1ba-4c0b-bd8b-f8428797d35e not found, creating... [ 698.388338] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.388498] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.388634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.388854] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.389020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.390198] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.390198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.390198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.390198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.390198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.390198] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 13493514-a1ba-4c0b-bd8b-f8428797d35e is going to be created. [ 698.413851] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.414120] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.414176] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.414451] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.414674] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.414947] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.526570] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7cd0617-9eb8-4653-99d5-f446d01eeaf9 [ 698.528180] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.528180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.528180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.528180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.528180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.528180] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7cd0617-9eb8-4653-99d5-f446d01eeaf9 already deleted. [ 698.528586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7cd0617-9eb8-4653-99d5-f446d01eeaf9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.601045] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.601045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.601045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.601371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.601371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.601371] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23716b6-1df0-449b-b54b-5cbfb06165bd is going to be created. [ 698.633737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.633947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.633947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.634184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.634426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.647032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23716b6-1df0-449b-b54b-5cbfb06165bd in Status: UNINITIALIZED for 2s [ 698.857771] env[65446]: INFO networking_nsxv3.common.synchronization [None req-40bd1d88-7181-427c-a1d5-9a64d7cab0e5 None None] Enqueued Resource ID: 56f592ba-cc59-489d-b7cd-6b54a912190b with Priority: HIGHEST for action port [ 698.858342] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56f592ba-cc59-489d-b7cd-6b54a912190b with Priority: HIGHEST for action port [ 698.858672] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-56f592ba-cc59-489d-b7cd-6b54a912190b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.858799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56f592ba-cc59-489d-b7cd-6b54a912190b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.858843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56f592ba-cc59-489d-b7cd-6b54a912190b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.860252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56f592ba-cc59-489d-b7cd-6b54a912190b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.860252] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56f592ba-cc59-489d-b7cd-6b54a912190b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.177041] env[65446]: INFO networking_nsxv3.common.synchronization [req-f007d662-d662-42d8-bd8e-594e62a51ca7 req-2c99c489-2d4b-4631-a44a-e02a14623251 service nova] Enqueued Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_rules [ 699.177041] env[65446]: INFO networking_nsxv3.common.synchronization [req-f007d662-d662-42d8-bd8e-594e62a51ca7 req-2c99c489-2d4b-4631-a44a-e02a14623251 service nova] Enqueued Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_members [ 699.177041] env[65446]: INFO networking_nsxv3.common.synchronization [req-f007d662-d662-42d8-bd8e-594e62a51ca7 req-2c99c489-2d4b-4631-a44a-e02a14623251 service nova] Enqueued Resource ID: 13493514-a1ba-4c0b-bd8b-f8428797d35e with Priority: HIGHEST for action port [ 699.177041] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_rules [ 699.177041] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_members [ 699.177041] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13493514-a1ba-4c0b-bd8b-f8428797d35e with Priority: HIGHEST for action port [ 699.177871] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.177871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.177993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.178943] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.178943] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.181287] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.181287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.181287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.181287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.181517] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.181517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.181603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.181695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.181869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.182313] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.183260] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-13493514-a1ba-4c0b-bd8b-f8428797d35e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.183387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.183449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.183616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.183673] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13493514-a1ba-4c0b-bd8b-f8428797d35e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.363196] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56f592ba-cc59-489d-b7cd-6b54a912190b [ 699.363295] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.363477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.363477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.363962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.363962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.363962] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56f592ba-cc59-489d-b7cd-6b54a912190b already deleted. [ 699.363962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56f592ba-cc59-489d-b7cd-6b54a912190b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.644585] env[65446]: INFO networking_nsxv3.common.synchronization [req-1dba0810-927d-4049-92c0-617f76674b53 req-554f7c32-311c-4f76-9e68-b7f25d1b9ad8 tempest-ServerMetadataTestJSON-2072012199 tempest-ServerMetadataTestJSON-2072012199-project-member] Enqueued Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_members [ 699.645716] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_members [ 699.645817] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.645898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.645975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.647199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.647199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.647199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.647199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.647199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.647199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.647199] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.688335] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.690016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.690172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.691563] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13493514-a1ba-4c0b-bd8b-f8428797d35e with status ACTIVE [ 699.691563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.691753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.691804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.692111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.692111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.692563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.692563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.692712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.692987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.692987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.693365] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.693365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.693501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.693702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.693702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.693878] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13493514-a1ba-4c0b-bd8b-f8428797d35e is going to be updated. [ 699.717472] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.717720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.717791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.718035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.718168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.718374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13493514-a1ba-4c0b-bd8b-f8428797d35e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.150489] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.150489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.150489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.150489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.150489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.150489] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.151036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.151036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.151036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.151036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.151036] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 391166e5-be4d-4671-828e-1d856e081893 already deleted. [ 700.151036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.158856] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-6 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.159057] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.159138] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.159515] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.159801] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.159960] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.161496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.161496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.161496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.161496] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.161843] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.163789] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.163789] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.163789] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.163789] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.163789] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.189151] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.189151] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.189151] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.189151] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.189151] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-de69d9d0-85e3-454f-b84a-196d9737e762 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.189151] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.189151] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.189151] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.189151] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de69d9d0-85e3-454f-b84a-196d9737e762',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.196591] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.234963] env[65446]: INFO networking_nsxv3.common.synchronization [None req-46202c9d-a80b-4e5f-ae66-c131988e07a0 tempest-ServersTestFqdnHostnames-165323879 tempest-ServersTestFqdnHostnames-165323879-project-member] Enqueued Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_rules [ 700.235868] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_rules [ 700.237505] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.237934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.237934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.238075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.238987] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.399746] env[65446]: INFO networking_nsxv3.common.synchronization [None req-da1e9561-cd24-43b5-b6c2-fe96ac01ee61 tempest-ServersTestFqdnHostnames-165323879 tempest-ServersTestFqdnHostnames-165323879-project-member] Enqueued Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_rules [ 700.399746] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_rules [ 700.399746] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.399746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.661151] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23716b6-1df0-449b-b54b-5cbfb06165bd in Status: SUCCESS [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.661151] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.661151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.661151] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.691007] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.691322] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.691495] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.691808] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.692018] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.692256] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port de69d9d0-85e3-454f-b84a-196d9737e762 not found, creating... [ 700.692586] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.692797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.692957] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.693297] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.693511] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.693845] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.694085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.694250] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.694502] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.694710] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.694926] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: de69d9d0-85e3-454f-b84a-196d9737e762 is going to be created. [ 700.699522] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.699598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.699646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.699828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.699911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.700008] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98940883-9fda-4b23-9149-fb7213985597 is going to be created. [ 700.724048] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.724397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.724547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.724787] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.725027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.725316] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.727495] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.727495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.727495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.727680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.727746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.738270] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98940883-9fda-4b23-9149-fb7213985597 in Status: UNINITIALIZED for 2s [ 700.765195] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.765496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.765563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.765794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.765919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.766450] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743ab854-8016-4dd1-b444-e671e7099027 already deleted. [ 700.766450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.766450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.766562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.766645] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.167054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.167054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.167054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.167054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.167054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.167676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.167676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.167676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.167676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.167676] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.297822] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.297822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.297822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.298270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.298360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.301022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743ab854-8016-4dd1-b444-e671e7099027 already deleted. [ 701.301022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.467351] env[65446]: INFO networking_nsxv3.common.synchronization [req-1dba0810-927d-4049-92c0-617f76674b53 req-9e66bfbb-1685-4d75-bd45-a53b09ef20cb service nova] Enqueued Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_rules [ 701.467351] env[65446]: INFO networking_nsxv3.common.synchronization [req-1dba0810-927d-4049-92c0-617f76674b53 req-9e66bfbb-1685-4d75-bd45-a53b09ef20cb service nova] Enqueued Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_members [ 701.467351] env[65446]: INFO networking_nsxv3.common.synchronization [req-1dba0810-927d-4049-92c0-617f76674b53 req-9e66bfbb-1685-4d75-bd45-a53b09ef20cb service nova] Enqueued Resource ID: de69d9d0-85e3-454f-b84a-196d9737e762 with Priority: HIGHEST for action port [ 701.467864] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_rules [ 701.467864] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_members [ 701.467950] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de69d9d0-85e3-454f-b84a-196d9737e762 with Priority: HIGHEST for action port [ 701.468187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.468305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.468367] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.468656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.468696] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.471092] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.472043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.472043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.472154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.473380] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.473523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.473613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.474882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.474983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.475312] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.478279] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-de69d9d0-85e3-454f-b84a-196d9737e762 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.478279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.478279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.478279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.478279] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de69d9d0-85e3-454f-b84a-196d9737e762',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.631291] env[65446]: INFO networking_nsxv3.common.synchronization [None req-39a88044-2d02-4daf-9faa-f62042350965 None None] Enqueued Resource ID: e9c784bd-7cf7-4e2f-9019-e2c9403c743c with Priority: HIGHEST for action port [ 701.632373] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c784bd-7cf7-4e2f-9019-e2c9403c743c with Priority: HIGHEST for action port [ 701.633351] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9c784bd-7cf7-4e2f-9019-e2c9403c743c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.633680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9c784bd-7cf7-4e2f-9019-e2c9403c743c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.633760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9c784bd-7cf7-4e2f-9019-e2c9403c743c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.634029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9c784bd-7cf7-4e2f-9019-e2c9403c743c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.634124] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9c784bd-7cf7-4e2f-9019-e2c9403c743c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.670337] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e23716b6-1df0-449b-b54b-5cbfb06165bd: rpc.has_security_group_logging(os_id): False [ 701.698584] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.698584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.698584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.698584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.698584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.698584] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.698584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.698584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.699156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.699360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.699752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.699973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.700120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.700361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.700881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.701199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.701423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.701555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.701892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.702089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.702363] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23716b6-1df0-449b-b54b-5cbfb06165bd is going to be created. [ 701.792861] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.793054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.793159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.793312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.793500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.811215] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23716b6-1df0-449b-b54b-5cbfb06165bd in Status: IN_PROGRESS for 2s [ 701.980302] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.980480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.980627] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de69d9d0-85e3-454f-b84a-196d9737e762 with status ACTIVE [ 701.980948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.981158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.981206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.981564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.981674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.981897] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.981978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.982087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.982356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.982445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.982700] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.982832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.982949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.983217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.983299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.983396] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de69d9d0-85e3-454f-b84a-196d9737e762 is going to be updated. [ 701.984977] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.013814] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.014292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.014292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.014953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.015173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.015431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de69d9d0-85e3-454f-b84a-196d9737e762" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.136894] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9c784bd-7cf7-4e2f-9019-e2c9403c743c [ 702.137300] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.137488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.137690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.137972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.138123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.138262] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9c784bd-7cf7-4e2f-9019-e2c9403c743c already deleted. [ 702.138390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9c784bd-7cf7-4e2f-9019-e2c9403c743c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.488861] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.749482] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98940883-9fda-4b23-9149-fb7213985597 in Status: SUCCESS [ 702.749694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.749860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.750149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.750308] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.750755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.750755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.750755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.750755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.750934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.750934] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.991962] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.992177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.992236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.992467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.992562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.992665] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 391166e5-be4d-4671-828e-1d856e081893 is going to be created. [ 703.022695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.022883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.022995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.023281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.023466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.036383] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 391166e5-be4d-4671-828e-1d856e081893 in Status: UNINITIALIZED for 2s [ 703.253892] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.254107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.254207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.254463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.257893] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.257893] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.257893] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.257893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.257893] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.763024] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98940883-9fda-4b23-9149-fb7213985597: rpc.has_security_group_logging(os_id): False [ 703.784494] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.784494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.784494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.784494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.784494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.784494] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.784494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.784922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.784922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.784922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.784922] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.785125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.785125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.785201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.785592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.785592] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.785592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.785748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.785748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.785815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.786097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98940883-9fda-4b23-9149-fb7213985597 is going to be created. [ 703.826830] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e23716b6-1df0-449b-b54b-5cbfb06165bd in Status: SUCCESS [ 703.826830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.866289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.866289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.866289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.866289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.866289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.882326] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98940883-9fda-4b23-9149-fb7213985597 in Status: IN_PROGRESS for 2s [ 705.048167] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 391166e5-be4d-4671-828e-1d856e081893 in Status: SUCCESS [ 705.048578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.048578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.048843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.049099] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.049251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.049339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.049486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.049581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.049702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.049805] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.552421] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.552621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.552704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.552909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.553124] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.553307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.553411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.553572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.553659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.553999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.553999] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.554160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.554160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.554258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.554383] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.554820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.554820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.554820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.554820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.554982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.554982] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.906796] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98940883-9fda-4b23-9149-fb7213985597 in Status: SUCCESS [ 705.907473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.058814] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 391166e5-be4d-4671-828e-1d856e081893: rpc.has_security_group_logging(os_id): False [ 706.080620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.080783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.080835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.081082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.081182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.081371] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.081475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.081545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.081684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.081760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.081958] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.082061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.082123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.082264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.082407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.082507] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.082616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.082806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.082955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.083045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.083212] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 391166e5-be4d-4671-828e-1d856e081893 is going to be created. [ 706.144895] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.145106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.145150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.145448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.145707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.159567] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 391166e5-be4d-4671-828e-1d856e081893 in Status: IN_PROGRESS for 2s [ 706.349133] env[65446]: INFO networking_nsxv3.common.synchronization [req-58d4754c-4478-4a2e-b856-b698d0f5a536 req-02d075da-b4f7-40bd-8699-732879456ae1 tempest-ServerDiagnosticsNegativeTest-1583363276 tempest-ServerDiagnosticsNegativeTest-1583363276-project-member] Enqueued Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_members [ 706.349133] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGHEST for action security_group_members [ 706.349133] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.349133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.349133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.349447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.349689] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.349902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.350052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.350297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.350504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.350696] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.853286] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.853467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.853512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.853726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.853829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.858020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.858020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.858020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.858020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.858020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.858020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a0887e-2263-4406-985f-71a50777bccb is going to be updated. [ 706.885177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.886151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.886151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.886151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.886151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.895942] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a0887e-2263-4406-985f-71a50777bccb in Status: IN_PROGRESS for 2s [ 708.178601] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 391166e5-be4d-4671-828e-1d856e081893 in Status: SUCCESS [ 708.178915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.905844] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a0887e-2263-4406-985f-71a50777bccb in Status: SUCCESS [ 708.906013] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a0887e-2263-4406-985f-71a50777bccb deletion is rescheduled due to dependency. [ 708.906176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.095802] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9a23d3b5-e6b8-4f6c-89d4-60380d222dab None None] Enqueued Resource ID: e7b8c57a-4478-4d19-b35b-58b066793d07 with Priority: HIGHEST for action port [ 710.096259] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8c57a-4478-4d19-b35b-58b066793d07 with Priority: HIGHEST for action port [ 710.096626] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7b8c57a-4478-4d19-b35b-58b066793d07 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.096732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7b8c57a-4478-4d19-b35b-58b066793d07" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.096784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7b8c57a-4478-4d19-b35b-58b066793d07" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.097468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7b8c57a-4478-4d19-b35b-58b066793d07" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.097468] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7b8c57a-4478-4d19-b35b-58b066793d07',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.572650] env[65446]: INFO networking_nsxv3.common.synchronization [req-37d508a6-5174-4978-8183-dc996265e35e req-cc9c974b-4787-47c4-92a7-f16c5119ead6 tempest-ServersWithSpecificFlavorTestJSON-599263955 tempest-ServersWithSpecificFlavorTestJSON-599263955-project-member] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 710.573278] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 710.573934] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.573934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.573934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.574213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.574277] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.574380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.574441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.574626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.574731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.574767] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.600401] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7b8c57a-4478-4d19-b35b-58b066793d07 [ 710.600401] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.600401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.600401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.600553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.600553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.600661] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7b8c57a-4478-4d19-b35b-58b066793d07 already deleted. [ 710.600709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7b8c57a-4478-4d19-b35b-58b066793d07" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.758587] env[65446]: INFO networking_nsxv3.common.synchronization [req-92d84c38-6f42-4968-84da-7d4329cbb9b2 req-30bf4bb0-b92b-444f-b721-99ae89a8e4ad tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 710.759721] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 710.764396] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.764637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.764739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.765053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.765618] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.767233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.767350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.767691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.767844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.768103] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.079019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.079019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.079019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.079019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.079434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.079434] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.079434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.079434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.079584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.079651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.080402] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 is going to be updated. [ 711.114098] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.114454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.114454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.116123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.116123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.126022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: IN_PROGRESS for 2s [ 711.271610] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.271897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.271992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.272289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.272487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.273252] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.273445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.273557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.273803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.273890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.273981] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 already deleted. [ 711.274079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.315731] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.315938] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.316093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.316616] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.316768] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.316918] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.318064] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.319854] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.320031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.321082] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.321082] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.321082] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.321233] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.321285] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.321404] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.321592] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.345029] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.345123] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.345261] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.345515] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.349021] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-c5744418-7f3a-478e-af4b-8cbf42812108 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.349021] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.349021] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.349021] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.349021] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5744418-7f3a-478e-af4b-8cbf42812108',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.850220] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.850220] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.850220] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.850588] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.850699] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.850876] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port c5744418-7f3a-478e-af4b-8cbf42812108 not found, creating... [ 711.852068] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.852068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.852068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.852068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.852068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.852068] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.852327] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.852327] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.852671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.852759] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.854555] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: c5744418-7f3a-478e-af4b-8cbf42812108 is going to be created. [ 711.876145] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.876429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.876537] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.876847] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.877111] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.877357] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.495597] env[65446]: INFO networking_nsxv3.common.synchronization [req-f7e3ab88-e196-4a03-9e9b-4582de48af01 req-9913b2a8-7971-4825-bf63-fe60a62b8ead tempest-ServerPasswordTestJSON-531470353 tempest-ServerPasswordTestJSON-531470353-project-member] Enqueued Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_members [ 712.495938] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGHEST for action security_group_members [ 712.495938] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.496135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.496135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.496362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.496458] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.496548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.496604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.496744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.497786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.497786] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.614482] env[65446]: INFO networking_nsxv3.common.synchronization [req-92d84c38-6f42-4968-84da-7d4329cbb9b2 req-329288b0-435c-4d24-b74b-310d3f023ae1 service nova] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_rules [ 712.614482] env[65446]: INFO networking_nsxv3.common.synchronization [req-92d84c38-6f42-4968-84da-7d4329cbb9b2 req-329288b0-435c-4d24-b74b-310d3f023ae1 service nova] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 712.614482] env[65446]: INFO networking_nsxv3.common.synchronization [req-92d84c38-6f42-4968-84da-7d4329cbb9b2 req-329288b0-435c-4d24-b74b-310d3f023ae1 service nova] Enqueued Resource ID: c5744418-7f3a-478e-af4b-8cbf42812108 with Priority: HIGHEST for action port [ 712.615271] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_rules [ 712.615377] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 712.615774] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5744418-7f3a-478e-af4b-8cbf42812108 with Priority: HIGHEST for action port [ 712.615905] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.616040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.616110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.617318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.617318] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.617388] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.617974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.617974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.617974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.617974] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.617974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.618190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.618190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.618248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.619100] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.621293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5744418-7f3a-478e-af4b-8cbf42812108 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.621293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.621293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.621293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.621293] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5744418-7f3a-478e-af4b-8cbf42812108',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.712711] env[65446]: INFO networking_nsxv3.common.synchronization [None req-870a285d-78c7-424a-ac3c-589dec7ccf1f None None] Enqueued Resource ID: 4e5e6d09-dfee-4572-9e4b-0f9a8e376d89 with Priority: HIGHEST for action port [ 712.712854] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e5e6d09-dfee-4572-9e4b-0f9a8e376d89 with Priority: HIGHEST for action port [ 712.713184] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e5e6d09-dfee-4572-9e4b-0f9a8e376d89 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.713330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e5e6d09-dfee-4572-9e4b-0f9a8e376d89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.713397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e5e6d09-dfee-4572-9e4b-0f9a8e376d89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.713649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e5e6d09-dfee-4572-9e4b-0f9a8e376d89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.713725] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e5e6d09-dfee-4572-9e4b-0f9a8e376d89',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.000374] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.000494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.000494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.000842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.000956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.001175] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.001278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.001341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.001500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.001575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.001659] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23716b6-1df0-449b-b54b-5cbfb06165bd is going to be updated. [ 713.030800] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.031063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.031063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.031281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.031427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.043766] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23716b6-1df0-449b-b54b-5cbfb06165bd in Status: IN_PROGRESS for 2s [ 713.122788] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.122965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.125150] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.125150] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5744418-7f3a-478e-af4b-8cbf42812108 with status ACTIVE [ 713.125150] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.125150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.125467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.125600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.125705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.125875] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.125973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.126043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.126354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.126436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.126629] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.126784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.126784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.126926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.127028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.127098] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5744418-7f3a-478e-af4b-8cbf42812108 is going to be updated. [ 713.137536] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: SUCCESS [ 713.137731] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 deletion is rescheduled due to dependency. [ 713.137829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.149844] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.149844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.150649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.150649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.150649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.150649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5744418-7f3a-478e-af4b-8cbf42812108" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.217060] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e5e6d09-dfee-4572-9e4b-0f9a8e376d89 [ 713.217280] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.217415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.217486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.217705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.217796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.217891] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e5e6d09-dfee-4572-9e4b-0f9a8e376d89 already deleted. [ 713.217971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e5e6d09-dfee-4572-9e4b-0f9a8e376d89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.501170] env[65446]: INFO networking_nsxv3.common.synchronization [None req-3739bdc0-4621-4e0e-9be9-5b289eec7f06 tempest-ServersTestBootFromVolume-2126361038 tempest-ServersTestBootFromVolume-2126361038-project-member] Enqueued Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_rules [ 713.501475] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_rules [ 713.501773] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.501895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.502047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.502253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.502336] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.585605] env[65446]: INFO networking_nsxv3.common.synchronization [None req-2ba8c4ba-502a-439a-84c6-d127123fe94f tempest-ServersTestBootFromVolume-2126361038 tempest-ServersTestBootFromVolume-2126361038-project-member] Enqueued Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_rules [ 713.586270] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_rules [ 713.586627] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.586766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.629328] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.035940] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.036195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.036195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.036460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.036604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.036685] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 already deleted. [ 714.036748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.036912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.037077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.037165] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.132022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.132188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.132249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.132459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.132551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.132650] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be created. [ 714.158559] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.158712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.158787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.159376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.159376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.170216] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: UNINITIALIZED for 2s [ 714.378432] env[65446]: INFO networking_nsxv3.common.synchronization [req-30db574b-f91a-46ed-adad-6cb9175e5063 req-f207de52-0e91-4782-8730-5f54f48e7b17 tempest-ServerAddressesTestJSON-602000790 tempest-ServerAddressesTestJSON-602000790-project-member] Enqueued Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_members [ 714.378975] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_members [ 714.379274] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.379391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.379454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.379697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.379846] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.379942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.380008] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.380181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.380269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.380370] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.565635] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.566020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.566020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.566020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.566159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.566301] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 already deleted. [ 714.566554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.858939] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-936 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.859201] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-936" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.859530] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-936" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.859926] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-936" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.860540] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.861381] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.862082] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.862401] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.862994] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.863297] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.863447] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.863579] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.863714] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.863836] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.863936] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.864130] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.883498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.883498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.883498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.883498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.883498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.883498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.883911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.883911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.883911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.884111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.884147] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c796209-aa21-4233-aadb-c262182336b7 already deleted. [ 714.884752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.893868] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.894115] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.894267] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.894492] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-936" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.896017] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-13303cb1-77f5-4ef6-bad9-435144227a5e taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.896017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.896017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.896017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.896017] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13303cb1-77f5-4ef6-bad9-435144227a5e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.057865] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e23716b6-1df0-449b-b54b-5cbfb06165bd in Status: SUCCESS [ 715.058054] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e23716b6-1df0-449b-b54b-5cbfb06165bd deletion is rescheduled due to dependency. [ 715.058176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.405149] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.405472] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.405472] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.406429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.406429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.406429] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 13303cb1-77f5-4ef6-bad9-435144227a5e not found, creating... [ 715.406429] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.406797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.406797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.406992] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.412014] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.414196] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.414568] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.414745] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.415541] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.415541] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.415681] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 13303cb1-77f5-4ef6-bad9-435144227a5e is going to be created. [ 715.450126] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.450540] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.450845] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.451453] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.451846] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.453277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.180722] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 716.181074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.181112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.181528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.181528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.181674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.181674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.181793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.181872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.181959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.182068] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.222849] env[65446]: INFO networking_nsxv3.common.synchronization [req-30db574b-f91a-46ed-adad-6cb9175e5063 req-fc09adeb-2456-42b4-8885-43e20c4a850c service nova] Enqueued Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_rules [ 716.222849] env[65446]: INFO networking_nsxv3.common.synchronization [req-30db574b-f91a-46ed-adad-6cb9175e5063 req-fc09adeb-2456-42b4-8885-43e20c4a850c service nova] Enqueued Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_members [ 716.222849] env[65446]: INFO networking_nsxv3.common.synchronization [req-30db574b-f91a-46ed-adad-6cb9175e5063 req-fc09adeb-2456-42b4-8885-43e20c4a850c service nova] Enqueued Resource ID: 13303cb1-77f5-4ef6-bad9-435144227a5e with Priority: HIGHEST for action port [ 716.222849] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_rules [ 716.222849] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_members [ 716.222849] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13303cb1-77f5-4ef6-bad9-435144227a5e with Priority: HIGHEST for action port [ 716.222849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.222849] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.222849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.222849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.222849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.223426] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.223732] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-13303cb1-77f5-4ef6-bad9-435144227a5e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.223732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.224939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.224939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.224939] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13303cb1-77f5-4ef6-bad9-435144227a5e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.684723] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.684959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.685065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.685647] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.685870] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.686070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.686193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.686532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.686690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.686799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.686979] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.687096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.687162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.687324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.687480] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.687602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.687695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.687846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.687908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.687978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.688067] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.728025] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.728025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.728025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.728339] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13303cb1-77f5-4ef6-bad9-435144227a5e with status ACTIVE [ 716.728368] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.728906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.728906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.728906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.728906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.729230] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.729230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.729230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.729422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.729422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.729502] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.729595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.729651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.729829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.729936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.729968] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13303cb1-77f5-4ef6-bad9-435144227a5e is going to be updated. [ 716.756968] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.757138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.757138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.757676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.757676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.757889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13303cb1-77f5-4ef6-bad9-435144227a5e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.194348] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea407653-fe6d-49fc-ae9f-5964f5403512: rpc.has_security_group_logging(os_id): False [ 717.215626] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.215867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.215948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.216180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.216270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.216533] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.216876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.216876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.216876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.216957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.217619] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.217619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.217619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.217619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.218295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.218991] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.218991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.218991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.219200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.219297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.219359] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be created. [ 717.233645] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.299179] env[65446]: INFO networking_nsxv3.common.synchronization [req-8fd30304-f9dc-4129-b81f-6e9a28027aab req-69a9411a-b44d-493e-9aba-5226d63545f1 tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 717.299179] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 717.302263] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.304681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.304934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.305364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.305769] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.305985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.306141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.306428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.306604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.306776] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.316391] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.316544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.316611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.316818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.317014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.333098] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 717.737764] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.737764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.737764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.737764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.737764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.737764] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c796209-aa21-4233-aadb-c262182336b7 is going to be created. [ 717.762960] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.764124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.764124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.764124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.764124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.779876] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c796209-aa21-4233-aadb-c262182336b7 in Status: UNINITIALIZED for 2s [ 717.809530] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.809689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.809770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.810125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.811091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.811091] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.811091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.811091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.811091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.811091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.811091] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 already deleted. [ 717.811091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.879243] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.879946] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.880372] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.881127] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.881320] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.882891] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.882891] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.882891] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.882891] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.882891] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.882891] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.882891] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.883394] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.883394] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.883394] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.883394] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.910483] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.912048] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.912048] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.912048] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.912048] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-9d48208f-0742-4359-a531-ef46d0ce7881 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.912048] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.912992] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.912992] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.913088] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d48208f-0742-4359-a531-ef46d0ce7881',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.417165] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.417520] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.417520] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.417851] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.418015] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.418315] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 9d48208f-0742-4359-a531-ef46d0ce7881 not found, creating... [ 718.418817] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.418986] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.419126] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.419350] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.419488] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.419763] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.419932] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.420117] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.420339] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.420478] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.420643] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 9d48208f-0742-4359-a531-ef46d0ce7881 is going to be created. [ 718.443986] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.444467] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.444467] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.444857] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.444857] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.445135] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.168027] env[65446]: INFO networking_nsxv3.common.synchronization [req-8fd30304-f9dc-4129-b81f-6e9a28027aab req-691a11a1-ff84-42ca-a2c2-cca2db67c366 service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 719.168027] env[65446]: INFO networking_nsxv3.common.synchronization [req-8fd30304-f9dc-4129-b81f-6e9a28027aab req-691a11a1-ff84-42ca-a2c2-cca2db67c366 service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 719.168027] env[65446]: INFO networking_nsxv3.common.synchronization [req-8fd30304-f9dc-4129-b81f-6e9a28027aab req-691a11a1-ff84-42ca-a2c2-cca2db67c366 service nova] Enqueued Resource ID: 9d48208f-0742-4359-a531-ef46d0ce7881 with Priority: HIGHEST for action port [ 719.168027] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 719.168027] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 719.168027] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d48208f-0742-4359-a531-ef46d0ce7881 with Priority: HIGHEST for action port [ 719.168027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.168027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.168027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.168027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.168027] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.170964] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.171118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.171503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.171503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.171699] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.171699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.171868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.171971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.171971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.172077] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.173781] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d48208f-0742-4359-a531-ef46d0ce7881 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.173781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.173781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.173781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.173781] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d48208f-0742-4359-a531-ef46d0ce7881',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.344855] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 719.345235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.431155] env[65446]: INFO networking_nsxv3.common.synchronization [req-0a706c1a-163e-45b9-85a9-ef5a61c20552 req-1070b928-b022-4690-8484-9a22dfdc74f2 tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 719.431741] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 719.432530] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.432745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.433901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.434207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.434460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.434633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.434761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.435011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.435363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.435363] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.455837] env[65446]: INFO networking_nsxv3.common.synchronization [None req-20468eab-9dd3-4064-a7fb-e22eb950f939 None None] Enqueued Resource ID: 9fa01981-ab55-4719-ac1d-9a6393b3cfc0 with Priority: HIGHEST for action port [ 719.456346] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa01981-ab55-4719-ac1d-9a6393b3cfc0 with Priority: HIGHEST for action port [ 719.456674] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fa01981-ab55-4719-ac1d-9a6393b3cfc0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.456895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fa01981-ab55-4719-ac1d-9a6393b3cfc0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.456895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fa01981-ab55-4719-ac1d-9a6393b3cfc0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.459317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fa01981-ab55-4719-ac1d-9a6393b3cfc0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.460806] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa01981-ab55-4719-ac1d-9a6393b3cfc0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.676917] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.676917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.676917] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.677773] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d48208f-0742-4359-a531-ef46d0ce7881 with status ACTIVE [ 719.677972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.678102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.678169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.678373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.678460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.678637] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.678729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.678788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.678935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.679023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.679208] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.679297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.679355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.681058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.681058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.681058] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d48208f-0742-4359-a531-ef46d0ce7881 is going to be updated. [ 719.702661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.702807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.702880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.703160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.703250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.703445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d48208f-0742-4359-a531-ef46d0ce7881" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.800190] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c796209-aa21-4233-aadb-c262182336b7 in Status: SUCCESS [ 719.800399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.804026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.804026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.804026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.804026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.804026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.804026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.804026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.804026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.804026] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.811025] env[65446]: INFO networking_nsxv3.common.synchronization [req-c06119da-d9ec-4582-b4dc-f18028bbbd8f req-fbf994dc-7bd1-471a-8eee-52bc1f9266e3 tempest-AttachInterfacesV270Test-1119274591 tempest-AttachInterfacesV270Test-1119274591-project-member] Enqueued Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_members [ 719.811025] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGHEST for action security_group_members [ 719.811025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.811025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.811025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.811025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.811025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.811025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.811590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.811590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.811988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.812135] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.937915] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.938038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.938114] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.938334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.938434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.938661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.938774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.938872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.939020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.939168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.939211] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 719.963899] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fa01981-ab55-4719-ac1d-9a6393b3cfc0 [ 719.964287] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.964482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.964604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.964901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965136] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fa01981-ab55-4719-ac1d-9a6393b3cfc0 already deleted. [ 719.965220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fa01981-ab55-4719-ac1d-9a6393b3cfc0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.977420] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.977606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.978613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.978613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.978613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.989842] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 720.182182] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.306869] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.307089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.307132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.307417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.307543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.311290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.311427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.311587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.311697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.311884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.312110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.312227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.312305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.312469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.312647] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.312749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.312807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.312951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.313035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.313126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.313209] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.314632] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.314753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.314896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.315609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.315746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.315895] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.319045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.320159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.320475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.320599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.321016] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98940883-9fda-4b23-9149-fb7213985597 is going to be updated. [ 720.358380] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.358703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.358703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.359845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.359845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.371152] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98940883-9fda-4b23-9149-fb7213985597 in Status: IN_PROGRESS for 2s [ 720.687072] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.687072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.687072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.687072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.687072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.687072] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be created. [ 720.710360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.710613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.710613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.710751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.710905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.723732] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: UNINITIALIZED for 2s [ 720.822611] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c796209-aa21-4233-aadb-c262182336b7: rpc.has_security_group_logging(os_id): False [ 720.842981] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.843174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.843267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.843589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.843724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.843950] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.844074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.844161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.844345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.844445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.844661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.844769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.844850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.845017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.845611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.845809] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.845931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.845995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.846173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.846253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.846341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c796209-aa21-4233-aadb-c262182336b7 is going to be created. [ 720.921484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.921662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.921744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.921945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.922145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.936924] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c796209-aa21-4233-aadb-c262182336b7 in Status: IN_PROGRESS for 2s [ 722.001306] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 722.001718] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 722.001718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.080572] env[65446]: INFO networking_nsxv3.common.synchronization [None req-6bc52349-1d9e-4b53-a25f-42259812aff7 None None] Enqueued Resource ID: 35fb9692-b0a3-4fa4-9480-1437eddfd9d6 with Priority: HIGHEST for action port [ 722.081268] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35fb9692-b0a3-4fa4-9480-1437eddfd9d6 with Priority: HIGHEST for action port [ 722.082123] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-35fb9692-b0a3-4fa4-9480-1437eddfd9d6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.083450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35fb9692-b0a3-4fa4-9480-1437eddfd9d6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.083450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35fb9692-b0a3-4fa4-9480-1437eddfd9d6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.083450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35fb9692-b0a3-4fa4-9480-1437eddfd9d6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.083450] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35fb9692-b0a3-4fa4-9480-1437eddfd9d6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.382763] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98940883-9fda-4b23-9149-fb7213985597 in Status: SUCCESS [ 722.383058] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98940883-9fda-4b23-9149-fb7213985597 deletion is rescheduled due to dependency. [ 722.383154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.585393] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35fb9692-b0a3-4fa4-9480-1437eddfd9d6 [ 722.585734] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.585948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.586103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.586318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.586429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.586542] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35fb9692-b0a3-4fa4-9480-1437eddfd9d6 already deleted. [ 722.586637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35fb9692-b0a3-4fa4-9480-1437eddfd9d6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.738482] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.738482] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.738482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.738482] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.954035] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c796209-aa21-4233-aadb-c262182336b7 in Status: SUCCESS [ 722.955193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.246021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.246021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.246021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.246021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.246021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.247025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.247025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.247025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.247025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.247025] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.756794] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e72bae3-70cb-43fb-a5f0-90cde0349d10: rpc.has_security_group_logging(os_id): False [ 723.777100] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.777313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.777357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.777734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.777841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.778472] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.778472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.778472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.778472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.778683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.778861] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.779048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.779148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.779410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.779533] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.779860] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.780065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.780129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.780375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.780544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.780664] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be created. [ 723.864412] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.864412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.864412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.864412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.864412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.865831] env[65446]: INFO networking_nsxv3.common.synchronization [req-c4de84be-f2f9-42b8-9f1e-1c809814e304 req-df14dbc1-da95-4cf3-a01d-209679641365 tempest-ListServersNegativeTestJSON-366548564 tempest-ListServersNegativeTestJSON-366548564-project-member] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 723.866665] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 723.867028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.867193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.867310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.867570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.867800] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.867928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.868240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.868444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.869257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.869257] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.875670] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 724.153696] env[65446]: INFO networking_nsxv3.common.synchronization [req-93f45ec4-3adf-4f88-9d4c-7716f26f8892 req-c0d2e1a3-f0cb-44cd-a5d3-9525b5dbb24e tempest-ServersAdminNegativeTestJSON-1179735760 tempest-ServersAdminNegativeTestJSON-1179735760-project-member] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 724.153812] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 724.156328] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.156515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.156598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.156868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.157374] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.157374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.157548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.157977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.157977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.157977] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.371846] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.660931] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.773771] env[65446]: INFO networking_nsxv3.common.synchronization [req-3a544f09-5464-4e10-8d34-12fa1a19dbe3 req-2e14be9d-66f3-4d79-8059-34e026cdd5be tempest-ListServersNegativeTestJSON-366548564 tempest-ListServersNegativeTestJSON-366548564-project-member] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 724.773981] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGHEST for action security_group_members [ 724.774563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.774685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.876746] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.164990] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.380850] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.381196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.381196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.381411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.381411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.381624] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 725.413818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.414100] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.414206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.414500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.414595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.425109] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 725.670575] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.670575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.670575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.670575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.670575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.670575] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be updated. [ 725.703053] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.703053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.703472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.703472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.703717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.714793] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: IN_PROGRESS for 2s [ 725.891210] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 725.891210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.438885] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 727.438885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.438885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.439401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.439401] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.439401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.439523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.439576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.439656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.439754] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.728784] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: SUCCESS [ 727.728784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.944773] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.944773] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.944773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.944773] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be updated. [ 727.976479] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.976800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.976800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.976970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.977141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.988824] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: IN_PROGRESS for 2s [ 728.807162] env[65446]: INFO networking_nsxv3.common.synchronization [req-caf2b3b1-3cdc-4983-9698-717b65290722 req-9b2ebfab-0eff-4baf-b154-c108b47a65b5 tempest-ServerMetadataTestJSON-2072012199 tempest-ServerMetadataTestJSON-2072012199-project-member] Enqueued Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_members [ 728.807162] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGHEST for action security_group_members [ 728.807547] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.808637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.808637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.808637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.808637] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.808637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.808637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.809642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.809862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.810451] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.315298] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.315298] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.315298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.315298] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 391166e5-be4d-4671-828e-1d856e081893 is going to be updated. [ 729.344779] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.344927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.344999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.345307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.345525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.356147] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 391166e5-be4d-4671-828e-1d856e081893 in Status: IN_PROGRESS for 2s [ 729.998259] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 in Status: SUCCESS [ 729.998543] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 deletion is rescheduled due to dependency. [ 729.998543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.617265] env[65446]: INFO networking_nsxv3.common.synchronization [req-73cde36e-a605-4686-a0ec-364a93a0db0a req-21435e1e-a77c-4a73-8225-8047d34bc94b tempest-ServerAddressesTestJSON-602000790 tempest-ServerAddressesTestJSON-602000790-project-member] Enqueued Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_members [ 730.618717] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGHEST for action security_group_members [ 730.619144] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.621819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.621819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.621819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.621819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.621819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.621819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.621819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.621819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.621819] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.124321] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.124735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.124735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.125052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.125162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.125691] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.125691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.125691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.125905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.125905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.126022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c796209-aa21-4233-aadb-c262182336b7 is going to be updated. [ 731.152364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.152522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.152589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.152763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.152906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.163174] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c796209-aa21-4233-aadb-c262182336b7 in Status: IN_PROGRESS for 2s [ 731.371477] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 391166e5-be4d-4671-828e-1d856e081893 in Status: SUCCESS [ 731.371556] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 391166e5-be4d-4671-828e-1d856e081893 deletion is rescheduled due to dependency. [ 731.371635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.466780] env[65446]: INFO networking_nsxv3.common.synchronization [req-71aacbf5-e044-4064-a732-a023552d2fad req-69de45ef-8497-411a-8292-8c87ddfa8c83 tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 732.467502] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 732.468043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.468043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.468185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.468420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.468599] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.468753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.468839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.469061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.469170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.469314] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.840553] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.840553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.840553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.840719] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.840971] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.843069] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.843069] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.843069] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.843069] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.843069] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.843069] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.843069] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.843069] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.843069] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.843069] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.843069] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.862061] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.862256] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.862393] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.862573] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.862922] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-6a50fb51-eddd-40fc-8cfc-bb1710409907 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.863117] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.863239] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.863593] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.863743] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a50fb51-eddd-40fc-8cfc-bb1710409907',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.974184] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.176614] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c796209-aa21-4233-aadb-c262182336b7 in Status: SUCCESS [ 733.176614] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c796209-aa21-4233-aadb-c262182336b7 deletion is rescheduled due to dependency. [ 733.176614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.366574] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366574] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366574] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.366840] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.367534] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.367534] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 6a50fb51-eddd-40fc-8cfc-bb1710409907 not found, creating... [ 733.367534] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.367534] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.367839] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.367867] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.369346] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.369346] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.369346] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.369346] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.369346] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.369346] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.369346] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 6a50fb51-eddd-40fc-8cfc-bb1710409907 is going to be created. [ 733.390893] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.391117] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.391230] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.391495] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.392633] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.392633] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.476427] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.978852] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.979139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.979139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.979376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.979437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.979515] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 734.007765] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.007928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.007999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.008234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.008384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.017579] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 734.157253] env[65446]: INFO networking_nsxv3.common.synchronization [req-71aacbf5-e044-4064-a732-a023552d2fad req-ea0467fe-e672-486d-be10-399bcfe60927 service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 734.158307] env[65446]: INFO networking_nsxv3.common.synchronization [req-71aacbf5-e044-4064-a732-a023552d2fad req-ea0467fe-e672-486d-be10-399bcfe60927 service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 734.158560] env[65446]: INFO networking_nsxv3.common.synchronization [req-71aacbf5-e044-4064-a732-a023552d2fad req-ea0467fe-e672-486d-be10-399bcfe60927 service nova] Enqueued Resource ID: 6a50fb51-eddd-40fc-8cfc-bb1710409907 with Priority: HIGHEST for action port [ 734.158851] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 734.159029] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 734.159125] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a50fb51-eddd-40fc-8cfc-bb1710409907 with Priority: HIGHEST for action port [ 734.159738] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.159969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.160080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.160526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.161148] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.163385] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.163385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.163527] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a50fb51-eddd-40fc-8cfc-bb1710409907 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.163613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.163736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.163974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.164120] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a50fb51-eddd-40fc-8cfc-bb1710409907',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.664111] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.664653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.667071] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a50fb51-eddd-40fc-8cfc-bb1710409907 with status ACTIVE [ 734.667291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.667492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.667492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.667711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.668092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.668092] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.668207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.668207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.668306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.668535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.668646] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.668646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.668718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.668826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.668894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.668976] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a50fb51-eddd-40fc-8cfc-bb1710409907 is going to be updated. [ 734.697316] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.697464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.700782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.700782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.700782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.700782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a50fb51-eddd-40fc-8cfc-bb1710409907" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.768139] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7e8904e5-110a-40b1-b947-c287d2925869 None None] Enqueued Resource ID: ff021191-352d-47da-893f-33f95200b766 with Priority: HIGHEST for action port [ 735.768730] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff021191-352d-47da-893f-33f95200b766 with Priority: HIGHEST for action port [ 735.769084] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff021191-352d-47da-893f-33f95200b766 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.769212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff021191-352d-47da-893f-33f95200b766" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.769279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff021191-352d-47da-893f-33f95200b766" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.769532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff021191-352d-47da-893f-33f95200b766" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.769618] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff021191-352d-47da-893f-33f95200b766',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.029898] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 736.030261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.031371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.031371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.031371] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.031371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.031371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.031371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.031831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.031831] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.271599] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff021191-352d-47da-893f-33f95200b766 [ 736.271867] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.272014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.272144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.272387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.272493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.272577] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff021191-352d-47da-893f-33f95200b766 already deleted. [ 736.272653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff021191-352d-47da-893f-33f95200b766" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.538171] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.039769] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.545099] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.545285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.545388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.545761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.545944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.546035] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 737.581381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.581651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.581651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.581805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.581950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.594649] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 738.891328] env[65446]: INFO networking_nsxv3.common.synchronization [None req-78e41d8f-58fa-400a-9d4f-d0d6ba14352a None None] Enqueued Resource ID: 61466153-ad10-4c58-b05d-83eb26750ea2 with Priority: HIGHEST for action port [ 738.892687] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61466153-ad10-4c58-b05d-83eb26750ea2 with Priority: HIGHEST for action port [ 738.893038] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-61466153-ad10-4c58-b05d-83eb26750ea2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.893219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61466153-ad10-4c58-b05d-83eb26750ea2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.893219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61466153-ad10-4c58-b05d-83eb26750ea2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.893782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61466153-ad10-4c58-b05d-83eb26750ea2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.893782] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61466153-ad10-4c58-b05d-83eb26750ea2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.001022] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9251bf2c-cefd-45e7-abc9-92eb914cdaf1 None None] Enqueued Resource ID: c6f16983-44f5-46e3-9562-cd2107155764 with Priority: HIGHEST for action port [ 739.001022] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f16983-44f5-46e3-9562-cd2107155764 with Priority: HIGHEST for action port [ 739.001022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6f16983-44f5-46e3-9562-cd2107155764 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.001022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6f16983-44f5-46e3-9562-cd2107155764" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.001022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6f16983-44f5-46e3-9562-cd2107155764" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.002502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6f16983-44f5-46e3-9562-cd2107155764" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.003119] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6f16983-44f5-46e3-9562-cd2107155764',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.197855] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-213d8ab2-4536-401a-86e3-6449e5c720a0 tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 739.200020] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 739.200020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.200020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.200020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.200020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.200622] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.200739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.200739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.200938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.201037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.201135] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.224963] env[65446]: INFO networking_nsxv3.common.synchronization [None req-24b84b82-6f2b-4175-a20a-59353ee4942a None None] Enqueued Resource ID: 7813ec84-cf7d-4558-9b30-923ff5e9e18f with Priority: HIGHEST for action port [ 739.224963] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7813ec84-cf7d-4558-9b30-923ff5e9e18f with Priority: HIGHEST for action port [ 739.225904] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-7813ec84-cf7d-4558-9b30-923ff5e9e18f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.225904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7813ec84-cf7d-4558-9b30-923ff5e9e18f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.226079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7813ec84-cf7d-4558-9b30-923ff5e9e18f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.231176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7813ec84-cf7d-4558-9b30-923ff5e9e18f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.231176] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7813ec84-cf7d-4558-9b30-923ff5e9e18f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.397677] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61466153-ad10-4c58-b05d-83eb26750ea2 [ 739.398262] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.398262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.398424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.398709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.398709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.398853] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61466153-ad10-4c58-b05d-83eb26750ea2 already deleted. [ 739.398853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61466153-ad10-4c58-b05d-83eb26750ea2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.509278] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6f16983-44f5-46e3-9562-cd2107155764 [ 739.509573] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.509746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.509901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.510104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.510216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.510587] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6f16983-44f5-46e3-9562-cd2107155764 already deleted. [ 739.510587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6f16983-44f5-46e3-9562-cd2107155764" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.555498] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-09cf10ec-bf28-4805-98a4-f1b167ace2f8 tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 739.556418] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 739.557233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.557717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.609000] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.609000] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.609000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.609000] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.705555] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.706380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.706380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.706380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.706380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.706562] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.706562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.709179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.709179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.709179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.709179] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 739.734042] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7813ec84-cf7d-4558-9b30-923ff5e9e18f [ 739.734261] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.734403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.734460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.734680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.734794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.734901] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7813ec84-cf7d-4558-9b30-923ff5e9e18f already deleted. [ 739.735036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7813ec84-cf7d-4558-9b30-923ff5e9e18f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.740724] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.743098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.743098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.743098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.743098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.754020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 740.088927] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.089393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-978" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.089393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-978" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.090129] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-978" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.092755] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.093084] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.093290] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.093847] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.094078] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.094401] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.094626] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.095524] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.098237] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.098237] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.098237] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.098237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.112043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.112260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.112355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.112632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.112865] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.112974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.113079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.113287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.113401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.113526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.113690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.113824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.113891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.114103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.114436] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.114436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.114551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.114746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.114840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.114946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.116392] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.120803] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.121637] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.121637] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.121637] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-978" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.121950] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-ab063d0d-62f1-4438-85d5-25cae141ba10 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.122659] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.122659] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.122822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.122962] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab063d0d-62f1-4438-85d5-25cae141ba10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.619244] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e72bae3-70cb-43fb-a5f0-90cde0349d10: rpc.has_security_group_logging(os_id): False [ 740.626199] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.626386] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.626492] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.627631] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.627631] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.627631] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port ab063d0d-62f1-4438-85d5-25cae141ba10 not found, creating... [ 740.627631] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.627631] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.627631] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.627973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.627973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.628197] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.628351] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.628463] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.628667] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.630030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.630030] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: ab063d0d-62f1-4438-85d5-25cae141ba10 is going to be created. [ 740.639634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.641078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.641078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.641078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.641078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.641078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.641078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.641078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.641354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.641354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.641689] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.641843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.641958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.642196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.642328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.643780] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.643780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.643780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.643780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.643780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.643780] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 740.660116] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.660116] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.660116] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.660272] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.660645] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.660909] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.716855] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.716855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.716855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.717155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.717452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.737134] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 741.447020] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-dc62c81d-1fd0-425c-935e-8fa473638e0d service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 741.447326] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-dc62c81d-1fd0-425c-935e-8fa473638e0d service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 741.448179] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-dc62c81d-1fd0-425c-935e-8fa473638e0d service nova] Enqueued Resource ID: ab063d0d-62f1-4438-85d5-25cae141ba10 with Priority: HIGHEST for action port [ 741.448443] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 741.451338] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 741.451402] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab063d0d-62f1-4438-85d5-25cae141ba10 with Priority: HIGHEST for action port [ 741.451878] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.452203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.452203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.452425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.452508] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.455610] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.455776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.456206] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab063d0d-62f1-4438-85d5-25cae141ba10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.456206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.456206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.456411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.456411] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab063d0d-62f1-4438-85d5-25cae141ba10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.764320] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 741.765446] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 deletion is rescheduled due to dependency. [ 741.765446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.765446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.765446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.765446] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.766221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.766221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.766221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.766221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.766221] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.891989] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9358b92b-7ff9-4543-afa9-4fd015fb9b23 None None] Enqueued Resource ID: fac1061a-c0d0-4398-9bdf-b704d20b4bd3 with Priority: HIGHEST for action port [ 741.892297] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fac1061a-c0d0-4398-9bdf-b704d20b4bd3 with Priority: HIGHEST for action port [ 741.894380] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fac1061a-c0d0-4398-9bdf-b704d20b4bd3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.894380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fac1061a-c0d0-4398-9bdf-b704d20b4bd3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.894380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fac1061a-c0d0-4398-9bdf-b704d20b4bd3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.894380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fac1061a-c0d0-4398-9bdf-b704d20b4bd3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.894380] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fac1061a-c0d0-4398-9bdf-b704d20b4bd3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.930850] env[65446]: INFO networking_nsxv3.common.synchronization [req-960c7dba-b804-4a1e-810d-c79c41a6e1d8 req-81aae873-43a2-494c-8bc6-a2a32dfb5585 tempest-ImagesOneServerTestJSON-758744168 tempest-ImagesOneServerTestJSON-758744168-project-member] Enqueued Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_members [ 741.930898] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_members [ 741.932856] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.932856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.932856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.932856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.933080] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.933195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.933264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.933461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.933578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.933706] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.958310] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.958591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.962542] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab063d0d-62f1-4438-85d5-25cae141ba10 with status ACTIVE [ 741.964044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.964044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.964044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.964044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.964044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.964044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.964044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.964044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.964410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.964441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.964918] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.964918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.964918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.965375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.965375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.965690] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab063d0d-62f1-4438-85d5-25cae141ba10 is going to be updated. [ 741.997037] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.997219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.997342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.997633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.997838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.998274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab063d0d-62f1-4438-85d5-25cae141ba10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.050921] env[65446]: INFO networking_nsxv3.common.synchronization [None req-f759a977-cf4d-47b5-93fe-2beadaf8c09d None None] Enqueued Resource ID: bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5 with Priority: HIGHEST for action port [ 742.051532] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5 with Priority: HIGHEST for action port [ 742.056023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.056023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.056023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.056023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.056023] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.268769] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.400219] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fac1061a-c0d0-4398-9bdf-b704d20b4bd3 [ 742.400219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.400219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.400219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.400488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.400488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.400488] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fac1061a-c0d0-4398-9bdf-b704d20b4bd3 already deleted. [ 742.400625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fac1061a-c0d0-4398-9bdf-b704d20b4bd3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.436470] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.436769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.436890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.437135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.437242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.437445] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.437582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.437644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.437786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.437883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.437974] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 already deleted. [ 742.438093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.557246] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5 [ 742.558661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.558661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.558661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.558661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.558661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.558860] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5 already deleted. [ 742.558860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc36ab2b-005d-40d6-9a2a-2a22e5fd4ec5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.572022] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-694 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.572022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.572274] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.572484] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.573093] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.573093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.573093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.574377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.574584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.574836] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.574979] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.575273] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.575273] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.575405] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.575532] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.575779] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.597777] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.597777] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.597911] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.598265] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.598694] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.599098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.599098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.599532] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.599744] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.752699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 742.752948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.772076] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.104634] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.104634] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 not found, creating... [ 743.104634] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.104634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.105191] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.105191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.105191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.105191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.105986] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.106103] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 is going to be created. [ 743.128479] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.128813] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.128942] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.129250] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.129480] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.129703] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.136393] env[65446]: INFO networking_nsxv3.common.synchronization [None req-6ec5f97a-3d58-466d-892c-8744063e1a3c None None] Enqueued Resource ID: 2b084a53-bb77-4022-aea4-2a0ea511e648 with Priority: HIGHEST for action port [ 743.136933] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b084a53-bb77-4022-aea4-2a0ea511e648 with Priority: HIGHEST for action port [ 743.137291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b084a53-bb77-4022-aea4-2a0ea511e648 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.137418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b084a53-bb77-4022-aea4-2a0ea511e648" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.137473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b084a53-bb77-4022-aea4-2a0ea511e648" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.137720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b084a53-bb77-4022-aea4-2a0ea511e648" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.137803] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b084a53-bb77-4022-aea4-2a0ea511e648',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.246749] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.247823] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-558" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.247823] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-558" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.248104] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-558" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.248380] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.248531] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.248641] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.248859] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.248993] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.249219] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.249357] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.249422] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.249521] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.249618] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.249712] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.249832] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.273391] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.274428] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.274428] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.274428] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-558" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.274836] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.275397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.275397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.275992] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.276099] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa301f1f-7d0c-4218-8a49-720d7d6e3ffc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.277590] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.277669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.277723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.278275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.278275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.278275] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 743.330903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.332111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.332111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.332111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.332111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.342084] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 743.577028] env[65446]: INFO networking_nsxv3.common.synchronization [None req-43ce420a-1942-4809-8cbd-4122d4c0df68 None None] Enqueued Resource ID: ada20e36-3e73-4eb4-b1fc-2f239630460e with Priority: HIGHEST for action port [ 743.577028] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada20e36-3e73-4eb4-b1fc-2f239630460e with Priority: HIGHEST for action port [ 743.577028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ada20e36-3e73-4eb4-b1fc-2f239630460e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.577028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ada20e36-3e73-4eb4-b1fc-2f239630460e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.577028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ada20e36-3e73-4eb4-b1fc-2f239630460e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.578461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ada20e36-3e73-4eb4-b1fc-2f239630460e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.578461] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ada20e36-3e73-4eb4-b1fc-2f239630460e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.640170] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b084a53-bb77-4022-aea4-2a0ea511e648 [ 743.640170] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.640329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.640363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.640634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.640722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.640759] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b084a53-bb77-4022-aea4-2a0ea511e648 already deleted. [ 743.641373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b084a53-bb77-4022-aea4-2a0ea511e648" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.781400] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.781649] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.781757] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.782122] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.782279] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.782434] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port aa301f1f-7d0c-4218-8a49-720d7d6e3ffc not found, creating... [ 743.782750] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.784870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.784870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.784870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.784870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.785742] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.785742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.785742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.786008] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.786218] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.786263] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: aa301f1f-7d0c-4218-8a49-720d7d6e3ffc is going to be created. [ 743.809290] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.809665] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.810327] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.810327] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.810649] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.811333] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.872150] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-9c2d8557-cf36-477f-81ff-3532c4734fb1 service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 743.873054] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-9c2d8557-cf36-477f-81ff-3532c4734fb1 service nova] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 743.873054] env[65446]: INFO networking_nsxv3.common.synchronization [req-24c2cceb-8a37-4604-93e6-2b746120ef8d req-9c2d8557-cf36-477f-81ff-3532c4734fb1 service nova] Enqueued Resource ID: a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 with Priority: HIGHEST for action port [ 743.873054] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_rules [ 743.873342] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 743.873342] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 with Priority: HIGHEST for action port [ 743.873496] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.873874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.874207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.874311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.874549] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.874688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.874774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.875032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.875120] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.081147] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ada20e36-3e73-4eb4-b1fc-2f239630460e [ 744.081419] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.081565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.081640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.081864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.081963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.082079] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ada20e36-3e73-4eb4-b1fc-2f239630460e already deleted. [ 744.082167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ada20e36-3e73-4eb4-b1fc-2f239630460e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.377579] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 with status ACTIVE [ 744.377579] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.377801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.377801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.377974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.378128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.378259] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.378356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.378416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.378562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.378638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.378941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.379061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.379100] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.379236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.379306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.379386] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66 is going to be updated. [ 744.405831] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.405831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.405831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.406105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.406141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.406737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a920b7a5-fb1e-49b8-8a50-2cf0ebe9ff66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.607532] env[65446]: INFO networking_nsxv3.common.synchronization [req-960c7dba-b804-4a1e-810d-c79c41a6e1d8 req-85d26352-4bd3-4cc9-bc73-475f5b09b552 service nova] Enqueued Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_rules [ 744.607954] env[65446]: INFO networking_nsxv3.common.synchronization [req-960c7dba-b804-4a1e-810d-c79c41a6e1d8 req-85d26352-4bd3-4cc9-bc73-475f5b09b552 service nova] Enqueued Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_members [ 744.607954] env[65446]: INFO networking_nsxv3.common.synchronization [req-960c7dba-b804-4a1e-810d-c79c41a6e1d8 req-85d26352-4bd3-4cc9-bc73-475f5b09b552 service nova] Enqueued Resource ID: aa301f1f-7d0c-4218-8a49-720d7d6e3ffc with Priority: HIGHEST for action port [ 744.608431] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_rules [ 744.608653] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_members [ 744.608786] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa301f1f-7d0c-4218-8a49-720d7d6e3ffc with Priority: HIGHEST for action port [ 744.609616] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.609616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.609616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.609926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.609926] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.610884] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.611014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.611080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.611404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.611571] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.611763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.611827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.612040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.612136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.612238] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.613522] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.613651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.614030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.614030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.614030] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa301f1f-7d0c-4218-8a49-720d7d6e3ffc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.120053] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.120972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.121082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.121246] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa301f1f-7d0c-4218-8a49-720d7d6e3ffc with status ACTIVE [ 745.121409] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.121542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.122215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.122215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.122215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.122345] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.122455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.122556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.122771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.122928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.123420] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.124038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.124038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.124038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.124038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.124038] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa301f1f-7d0c-4218-8a49-720d7d6e3ffc is going to be updated. [ 745.146182] env[65446]: INFO networking_nsxv3.common.synchronization [req-62e3d60e-52e2-4363-a6f3-a676e3b9d5e1 req-fe568e2d-510b-4548-b8ba-30db3c2f5659 tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 745.146930] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 745.147445] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.147681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.147792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.148189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.148364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.148469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.148548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.148711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.148804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.148919] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.157357] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.157482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.157540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.157708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.157848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.158088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa301f1f-7d0c-4218-8a49-720d7d6e3ffc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.357878] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 745.358122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.358295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.359565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.359859] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.360033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.360126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.360326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.360416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.360520] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.418939] env[65446]: INFO networking_nsxv3.common.synchronization [None req-dc6565c0-f2da-4c38-9c0f-c1cd8e4a6c18 None None] Enqueued Resource ID: 2114a35e-3b07-4840-9fdb-a793058eb642 with Priority: HIGHEST for action port [ 745.418939] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2114a35e-3b07-4840-9fdb-a793058eb642 with Priority: HIGHEST for action port [ 745.418939] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2114a35e-3b07-4840-9fdb-a793058eb642 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.418939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2114a35e-3b07-4840-9fdb-a793058eb642" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.418939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2114a35e-3b07-4840-9fdb-a793058eb642" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.419707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2114a35e-3b07-4840-9fdb-a793058eb642" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.419707] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2114a35e-3b07-4840-9fdb-a793058eb642',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.626089] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.645229] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.645229] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.645229] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.646162] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.647070] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.649367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.649367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.649367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.649367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.649367] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.649367] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.649367] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.649367] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.649367] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.649367] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.649367] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.651455] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.651629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.651709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.652021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.652806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.652806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.653026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.653026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.653253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.653548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.653548] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 already deleted. [ 745.653673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.675648] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.675883] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.676067] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.677185] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.678305] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-ae29a6fc-6822-4694-8b38-2756b0a09529 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.678305] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.678484] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.678705] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.678916] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae29a6fc-6822-4694-8b38-2756b0a09529',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.862950] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.922571] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2114a35e-3b07-4840-9fdb-a793058eb642 [ 745.922888] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.923286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.923286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.923476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.923545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.923646] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2114a35e-3b07-4840-9fdb-a793058eb642 already deleted. [ 745.923722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2114a35e-3b07-4840-9fdb-a793058eb642" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.983767] env[65446]: INFO networking_nsxv3.common.synchronization [None req-054c5282-d121-4feb-89f5-bb1c7b654590 None None] Enqueued Resource ID: 3b9e1b38-5c51-4b84-a78b-10384899e500 with Priority: HIGHEST for action port [ 745.984682] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b9e1b38-5c51-4b84-a78b-10384899e500 with Priority: HIGHEST for action port [ 745.985241] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b9e1b38-5c51-4b84-a78b-10384899e500 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.985368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b9e1b38-5c51-4b84-a78b-10384899e500" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.985436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b9e1b38-5c51-4b84-a78b-10384899e500" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.985711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b9e1b38-5c51-4b84-a78b-10384899e500" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.985824] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9e1b38-5c51-4b84-a78b-10384899e500',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.128152] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.128628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.128628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.128628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.128801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.128801] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 is going to be created. [ 746.155388] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.155585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.155707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.155931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.156966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.166904] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 in Status: UNINITIALIZED for 2s [ 746.183548] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.183767] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.183883] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.184186] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.184327] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.184662] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port ae29a6fc-6822-4694-8b38-2756b0a09529 not found, creating... [ 746.184731] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.184887] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.184964] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.185760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.185760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.185760] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.185997] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.186149] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.186425] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.186605] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.186796] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: ae29a6fc-6822-4694-8b38-2756b0a09529 is going to be created. [ 746.206478] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.206795] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.206970] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.207443] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.207443] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.207656] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.367652] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.488766] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b9e1b38-5c51-4b84-a78b-10384899e500 [ 746.488766] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.488766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.488766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.488766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.489138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.489138] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b9e1b38-5c51-4b84-a78b-10384899e500 already deleted. [ 746.489138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b9e1b38-5c51-4b84-a78b-10384899e500" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.874458] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.874458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.874458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.874458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.874458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.874458] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 746.903248] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.903248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.903248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.903535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.903674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.914587] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 746.930150] env[65446]: INFO networking_nsxv3.common.synchronization [req-62e3d60e-52e2-4363-a6f3-a676e3b9d5e1 req-cdfcdaeb-64ae-495d-aefc-3b0085792669 service nova] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_rules [ 746.930256] env[65446]: INFO networking_nsxv3.common.synchronization [req-62e3d60e-52e2-4363-a6f3-a676e3b9d5e1 req-cdfcdaeb-64ae-495d-aefc-3b0085792669 service nova] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 746.930336] env[65446]: INFO networking_nsxv3.common.synchronization [req-62e3d60e-52e2-4363-a6f3-a676e3b9d5e1 req-cdfcdaeb-64ae-495d-aefc-3b0085792669 service nova] Enqueued Resource ID: ae29a6fc-6822-4694-8b38-2756b0a09529 with Priority: HIGHEST for action port [ 746.930912] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_rules [ 746.932569] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 746.933762] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae29a6fc-6822-4694-8b38-2756b0a09529 with Priority: HIGHEST for action port [ 746.933762] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.933762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.933762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.933933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.934036] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.935365] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.935490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.935558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.935767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.935966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.936138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.936222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.936378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.936462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.936553] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.937460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae29a6fc-6822-4694-8b38-2756b0a09529 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.937562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.937600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.937734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.937810] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae29a6fc-6822-4694-8b38-2756b0a09529',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.413042] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c9c8df4-e0b0-485b-939b-d74099ca4a1d req-7e88e445-c2e0-4930-bd67-a35becc78cb3 tempest-ServersTestFqdnHostnames-165323879 tempest-ServersTestFqdnHostnames-165323879-project-member] Enqueued Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_members [ 747.413895] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_members [ 747.414220] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.414362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.414461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.414778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.414938] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.415055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.415114] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.415272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.415369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.415466] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.439684] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.440787] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.440899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.445025] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae29a6fc-6822-4694-8b38-2756b0a09529 with status ACTIVE [ 747.445025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.445025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.445025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.445025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.445025] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae29a6fc-6822-4694-8b38-2756b0a09529 is going to be updated. [ 747.468826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.468966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.469053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.469268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.469406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.471712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae29a6fc-6822-4694-8b38-2756b0a09529" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.562049] env[65446]: INFO networking_nsxv3.common.synchronization [None req-1989caa3-d2ed-48bf-99cf-6eb176397579 tempest-ServerActionsV293TestJSON-141987590 tempest-ServerActionsV293TestJSON-141987590-project-member] Enqueued Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_rules [ 747.562754] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_rules [ 747.563893] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.563893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.563893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.563893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.563893] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.739948] env[65446]: INFO networking_nsxv3.common.synchronization [None req-3c112b9f-442e-4924-9004-a8ab487fb5e5 tempest-ServerActionsV293TestJSON-141987590 tempest-ServerActionsV293TestJSON-141987590-project-member] Enqueued Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_rules [ 747.740587] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_rules [ 747.740769] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.741083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.790509] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d8502183-2004-4637-8318-d3858ab0e1f9 None None] Enqueued Resource ID: fdd2eb16-cbbc-42f1-b43f-1824b79d875a with Priority: HIGHEST for action port [ 747.791457] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdd2eb16-cbbc-42f1-b43f-1824b79d875a with Priority: HIGHEST for action port [ 747.791825] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdd2eb16-cbbc-42f1-b43f-1824b79d875a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.791986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdd2eb16-cbbc-42f1-b43f-1824b79d875a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.792107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdd2eb16-cbbc-42f1-b43f-1824b79d875a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.792410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdd2eb16-cbbc-42f1-b43f-1824b79d875a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.792503] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdd2eb16-cbbc-42f1-b43f-1824b79d875a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.868044] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.868205] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-437" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.868286] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-437" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.868659] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-437" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.869382] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.869382] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.870725] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.870725] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.870725] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.870725] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.870725] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.870725] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.870725] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.870725] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.870725] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.871028] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.908403] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.908725] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.908758] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.908941] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-437" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.909414] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-5ed9579d-9512-45d1-a825-41ffb428ab08 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.909519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.909555] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.910133] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.910133] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed9579d-9512-45d1-a825-41ffb428ab08',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.918114] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.918435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.918531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.919432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.919432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.919432] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.919432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.919432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.919432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.919658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.919658] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743ab854-8016-4dd1-b444-e671e7099027 already deleted. [ 747.919713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.945699] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.087682] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.087854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.087926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.088157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.088279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.088343] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 already deleted. [ 748.088427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.088580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.088730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.088815] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.176697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 in Status: SUCCESS [ 748.176803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.177013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.177239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.177408] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.177538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.177604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.177862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.177862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.177961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.177996] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.298830] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdd2eb16-cbbc-42f1-b43f-1824b79d875a [ 748.299108] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.300650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.300650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.300650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.300650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.300650] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdd2eb16-cbbc-42f1-b43f-1824b79d875a already deleted. [ 748.300650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdd2eb16-cbbc-42f1-b43f-1824b79d875a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.413968] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.413968] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.413968] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.413968] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.413968] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.414259] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 5ed9579d-9512-45d1-a825-41ffb428ab08 not found, creating... [ 748.415238] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.415238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.415238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.415238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.415238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.415639] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.415639] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.415818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.416121] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.416983] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.416983] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 5ed9579d-9512-45d1-a825-41ffb428ab08 is going to be created. [ 748.439154] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.439154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.439154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.439154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.439154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.439154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.450617] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.450846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.450914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.451132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.451219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.451325] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be created. [ 748.478933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.478933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.478933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.478933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.478933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.504179] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: UNINITIALIZED for 2s [ 748.622285] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.622285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.622285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.622285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.622285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.622285] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 already deleted. [ 748.622285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.681539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.681757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.681871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.682131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.682313] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.682431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.682476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.682678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.682778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.682872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.683048] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.683148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.683209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.683372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.683554] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.683675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.683740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.683885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.683963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.684060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.684151] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.928348] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.928348] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.928348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.928348] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.930026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.930475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.930868] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.931404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.931744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.932604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.932901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.933511] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.188854] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716: rpc.has_security_group_logging(os_id): False [ 749.214400] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.214603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.214603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.214810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.214906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.215113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.215212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.215496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.215869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.215972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.216248] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.216388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.216486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.216838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.216980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.217261] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.217361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.217452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.217642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.217727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.217972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 is going to be created. [ 749.273525] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c9c8df4-e0b0-485b-939b-d74099ca4a1d req-28007476-a13f-40bb-8c1c-8d981f01f575 service nova] Enqueued Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_rules [ 749.273525] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c9c8df4-e0b0-485b-939b-d74099ca4a1d req-28007476-a13f-40bb-8c1c-8d981f01f575 service nova] Enqueued Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_members [ 749.273525] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c9c8df4-e0b0-485b-939b-d74099ca4a1d req-28007476-a13f-40bb-8c1c-8d981f01f575 service nova] Enqueued Resource ID: 5ed9579d-9512-45d1-a825-41ffb428ab08 with Priority: HIGHEST for action port [ 749.274360] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_rules [ 749.274554] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_members [ 749.274660] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ed9579d-9512-45d1-a825-41ffb428ab08 with Priority: HIGHEST for action port [ 749.274945] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.275099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.275195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.275368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.275447] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.276946] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.277317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.277416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.277680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.277957] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.279018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.279018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.279135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.281744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.281744] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.281744] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ed9579d-9512-45d1-a825-41ffb428ab08 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.281744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.281744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.281744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.281744] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed9579d-9512-45d1-a825-41ffb428ab08',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.295299] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.295429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.295772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.295903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.296144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.330349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 in Status: IN_PROGRESS for 2s [ 749.375356] env[65446]: INFO networking_nsxv3.common.synchronization [req-9ec8e0e0-e230-459d-82c1-2b100bdc420b req-e8cebb8c-2307-4d08-a9d1-196814d3023a tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 749.375888] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 749.376521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.376662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.431596] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.431738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.436140] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.749671] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.749671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.749671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.749671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.749671] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.749671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.749671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.749958] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.750369] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.750369] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.750369] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.751554] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.751554] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.751554] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.751554] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.751554] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.771392] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.771601] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.771781] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.772634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.772634] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-9f946435-d8a7-4912-88ca-317cbfc8cbc1 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.772634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.772634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.772891] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.772985] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f946435-d8a7-4912-88ca-317cbfc8cbc1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.784039] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.784039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.784275] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.785104] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ed9579d-9512-45d1-a825-41ffb428ab08 with status ACTIVE [ 749.785291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.785527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.785527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.785699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.785793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.785974] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.787112] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.787112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.787112] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ed9579d-9512-45d1-a825-41ffb428ab08 is going to be updated. [ 749.811037] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.811037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.811235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.811389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.811489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.811698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ed9579d-9512-45d1-a825-41ffb428ab08" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.938019] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.240426] env[65446]: INFO networking_nsxv3.common.synchronization [req-c0d1cbde-5635-49c7-8624-3c4ade149be5 req-c14be917-0cff-4ec6-a809-0e9f6adec0fe tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 750.241116] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 750.241550] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.241635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.241679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.241898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.242102] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.244171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.244239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.244437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.244554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.244663] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.276143] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.276847] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.276847] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.276984] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.278900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.278900] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 9f946435-d8a7-4912-88ca-317cbfc8cbc1 not found, creating... [ 750.278900] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.278900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.278900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.278900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.278900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.278900] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.278900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.278900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.279590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.279590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.279590] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 9f946435-d8a7-4912-88ca-317cbfc8cbc1 is going to be created. [ 750.288780] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.309025] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.309025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.309025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.309025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.309025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.309025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.443374] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.443541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.443622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.443992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.443992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.444174] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 750.478628] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.478628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.478628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.478912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.479036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.489428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 750.517089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 750.517354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.517535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.517766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.517961] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.518095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.518157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.518309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.518391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.518477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.518579] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.519461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.519635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.519816] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.519959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.520038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.520191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.520271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.520364] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.747168] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.747291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.747362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.747721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.747721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.747870] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.747931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.748018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.748141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.748220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.748312] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 750.779046] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.779203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.779243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.779426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.779569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.791912] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 750.792454] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.792633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.792667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.792868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.792959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.793069] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743ab854-8016-4dd1-b444-e671e7099027 is going to be created. [ 750.822638] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.823729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.823729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.823729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.823729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.834457] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743ab854-8016-4dd1-b444-e671e7099027 in Status: UNINITIALIZED for 2s [ 751.022969] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.022969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.022969] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.164957] env[65446]: INFO networking_nsxv3.common.synchronization [req-9ec8e0e0-e230-459d-82c1-2b100bdc420b req-f2541f40-2b3c-4300-af9b-cb56190915e7 service nova] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_rules [ 751.164957] env[65446]: INFO networking_nsxv3.common.synchronization [req-9ec8e0e0-e230-459d-82c1-2b100bdc420b req-f2541f40-2b3c-4300-af9b-cb56190915e7 service nova] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 751.164957] env[65446]: INFO networking_nsxv3.common.synchronization [req-9ec8e0e0-e230-459d-82c1-2b100bdc420b req-f2541f40-2b3c-4300-af9b-cb56190915e7 service nova] Enqueued Resource ID: 9f946435-d8a7-4912-88ca-317cbfc8cbc1 with Priority: HIGHEST for action port [ 751.164957] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_rules [ 751.164957] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 751.169097] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f946435-d8a7-4912-88ca-317cbfc8cbc1 with Priority: HIGHEST for action port [ 751.169827] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.170154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.172666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.172666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.172666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f946435-d8a7-4912-88ca-317cbfc8cbc1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.172666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.172666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.172666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.172666] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f946435-d8a7-4912-88ca-317cbfc8cbc1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.330828] env[65446]: INFO networking_nsxv3.common.synchronization [None req-321a12de-bf6e-4ac7-8eb2-288845d36b73 None None] Enqueued Resource ID: 46bb6bfa-2fb5-46f7-aa67-d874018c7dcf with Priority: HIGHEST for action port [ 751.332614] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46bb6bfa-2fb5-46f7-aa67-d874018c7dcf with Priority: HIGHEST for action port [ 751.332992] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-46bb6bfa-2fb5-46f7-aa67-d874018c7dcf taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.333177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46bb6bfa-2fb5-46f7-aa67-d874018c7dcf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.333243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46bb6bfa-2fb5-46f7-aa67-d874018c7dcf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.333517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46bb6bfa-2fb5-46f7-aa67-d874018c7dcf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.333625] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46bb6bfa-2fb5-46f7-aa67-d874018c7dcf',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.357245] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 in Status: SUCCESS [ 751.357245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.528253] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.675983] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f946435-d8a7-4912-88ca-317cbfc8cbc1 with status ACTIVE [ 751.676232] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.680898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.680898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.680898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.680898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.680898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.680898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.681175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.681175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.681230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.681805] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.681805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.681805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.681805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.681805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.681805] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f946435-d8a7-4912-88ca-317cbfc8cbc1 is going to be updated. [ 751.704061] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.704325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.704325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.704507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.704614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.704767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f946435-d8a7-4912-88ca-317cbfc8cbc1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.836559] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46bb6bfa-2fb5-46f7-aa67-d874018c7dcf [ 751.836752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.836896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.836961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.837217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.837395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.837470] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46bb6bfa-2fb5-46f7-aa67-d874018c7dcf already deleted. [ 751.837525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46bb6bfa-2fb5-46f7-aa67-d874018c7dcf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.032087] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.032632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.032632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.032632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.032632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.032866] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be updated. [ 752.069317] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.072130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.072130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.072130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.072130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.085227] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 752.503966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 752.504084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.504209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.504425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.504621] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.504740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.504808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.504962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.505216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.505216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.505484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.505484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.505484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.505583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.505733] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.505866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.505906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.506641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.508861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.508980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.509096] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.752671] env[65446]: INFO networking_nsxv3.common.synchronization [None req-64703cf9-9658-417d-8f5e-52449957a849 None None] Enqueued Resource ID: c1047c71-6a08-4355-ad8d-daa0c171bdad with Priority: HIGHEST for action port [ 752.754101] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1047c71-6a08-4355-ad8d-daa0c171bdad with Priority: HIGHEST for action port [ 752.754498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1047c71-6a08-4355-ad8d-daa0c171bdad taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.754615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1047c71-6a08-4355-ad8d-daa0c171bdad" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.754665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1047c71-6a08-4355-ad8d-daa0c171bdad" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.754982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1047c71-6a08-4355-ad8d-daa0c171bdad" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.755083] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1047c71-6a08-4355-ad8d-daa0c171bdad',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.804457] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 752.804771] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 deletion is rescheduled due to dependency. [ 752.804938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.850921] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743ab854-8016-4dd1-b444-e671e7099027 in Status: SUCCESS [ 752.850921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.850921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.851178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.851533] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.851733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.851809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.852107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.852255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.852371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.852466] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.011422] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fba5fede-4e1d-4734-bb87-51495f4aff23: rpc.has_security_group_logging(os_id): False [ 753.031036] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.031036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.031036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.031036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.032425] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.032425] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.032425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.033231] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.033231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.033231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.033231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.033231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.033231] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 753.100971] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.100971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.100971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.100971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.100971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.117044] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 753.259020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1047c71-6a08-4355-ad8d-daa0c171bdad [ 753.259020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.259020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.259020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.259020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.259020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.259020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1047c71-6a08-4355-ad8d-daa0c171bdad already deleted. [ 753.259020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1047c71-6a08-4355-ad8d-daa0c171bdad" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.355425] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.862128] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 743ab854-8016-4dd1-b444-e671e7099027: rpc.has_security_group_logging(os_id): False [ 753.882625] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.882844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.882950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.883401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.883401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.883662] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.883802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.883925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.884099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.884221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.884321] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743ab854-8016-4dd1-b444-e671e7099027 is going to be created. [ 753.955431] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.955604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.955719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.955976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.956451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.973894] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743ab854-8016-4dd1-b444-e671e7099027 in Status: IN_PROGRESS for 2s [ 754.101296] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 754.101296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.102938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.103290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.104031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.104173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.104418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.104570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.104728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.104894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.105219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.105309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.105393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.105608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.105911] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.106143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.106238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.106515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.106744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.106744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.106948] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.108100] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.108340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.108610] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.108801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.109619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.109619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.109619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.109619] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.612032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24: rpc.has_security_group_logging(os_id): False [ 754.613214] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.638126] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.638126] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.638126] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.638126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.638602] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.638858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.639069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.639317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.639519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.639821] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be created. [ 754.703031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.703803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.703803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.703803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.703803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.716383] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 755.116046] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.130937] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 755.131273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.131463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.131740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.131804] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.619392] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.619469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.619530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.619871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.619963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.620185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be updated. [ 755.634613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.634815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.634815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.635644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.635644] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.635644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.635644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.635644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.637536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.637536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.637536] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.644510] env[65446]: INFO networking_nsxv3.common.synchronization [None req-83e885cb-3fae-4ae0-8cf1-92464a9be063 None None] Enqueued Resource ID: ec8da623-bebe-4b61-bcb8-5e246658e508 with Priority: HIGHEST for action port [ 755.648807] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec8da623-bebe-4b61-bcb8-5e246658e508 with Priority: HIGHEST for action port [ 755.649256] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec8da623-bebe-4b61-bcb8-5e246658e508 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.652174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec8da623-bebe-4b61-bcb8-5e246658e508" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.652174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec8da623-bebe-4b61-bcb8-5e246658e508" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.652174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec8da623-bebe-4b61-bcb8-5e246658e508" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.652174] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec8da623-bebe-4b61-bcb8-5e246658e508',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.657172] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.657172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.657172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.657172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.657172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.668728] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 755.991255] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743ab854-8016-4dd1-b444-e671e7099027 in Status: SUCCESS [ 755.991483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.138240] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.138512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.138512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.138739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.138915] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.139033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.139120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.139341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.139476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.139573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.139727] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.139830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.139917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.140102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.140238] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.140351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.140568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.140641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.140758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.140851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.140955] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.149709] env[65446]: INFO networking_nsxv3.common.synchronization [req-c7d5d8cb-4584-4b64-98dc-461a5ccd1124 req-d258f7a3-6cb0-407e-b0a3-215d25418e33 tempest-MigrationsAdminTest-1736177509 tempest-MigrationsAdminTest-1736177509-project-member] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 756.149709] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 756.149709] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.149709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.149709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.149709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.149709] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.149709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.149709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.149709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.149709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.149709] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.160084] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec8da623-bebe-4b61-bcb8-5e246658e508 [ 756.160713] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.160713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.160713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.160924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.161167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.161290] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec8da623-bebe-4b61-bcb8-5e246658e508 already deleted. [ 756.161290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec8da623-bebe-4b61-bcb8-5e246658e508" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.648494] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fba5fede-4e1d-4734-bb87-51495f4aff23: rpc.has_security_group_logging(os_id): False [ 756.651455] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.676820] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.676982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.677061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.677370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.677370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.677597] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.677695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.677759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.677966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.678065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.678251] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.678369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.678409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.678662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.678662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.678845] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.678897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.678932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.679171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.679209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.679294] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 756.700712] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.700917] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.701081] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.701395] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.701793] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.701993] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.702128] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.702368] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.702748] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.702855] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.702941] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.703066] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.703175] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.703298] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.703461] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.703602] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.727192] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.727379] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.727631] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.727799] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.728395] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.728504] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.728591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.728957] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.729143] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('199ed3cd-a14e-42b1-8e93-a4bb347ee9d2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.736591] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 756.736882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.737119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.737397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.737510] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.767013] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.767210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.767210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.767497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.767616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.784594] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 757.154575] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.231688] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.231922] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.232059] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.232343] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.232488] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.232638] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 not found, creating... [ 757.232899] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.233066] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.233177] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.233391] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.233519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.233869] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.234053] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.234189] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.234389] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.234517] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.234667] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 is going to be created. [ 757.239237] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.239373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.257738] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.258056] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.258149] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.258367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.258625] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.258864] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.661608] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.661608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.661608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.661608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.661608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.661608] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be updated. [ 757.678207] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 757.678469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.678601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.678827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.679068] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.679255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.679349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.679529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.679643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.679750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.679864] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.693057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.693218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.693317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.693535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.693704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.703022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: IN_PROGRESS for 2s [ 758.008111] env[65446]: INFO networking_nsxv3.common.synchronization [req-c7d5d8cb-4584-4b64-98dc-461a5ccd1124 req-d4275331-4863-496b-a76b-409f3fa4ae18 service nova] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_rules [ 758.008391] env[65446]: INFO networking_nsxv3.common.synchronization [req-c7d5d8cb-4584-4b64-98dc-461a5ccd1124 req-d4275331-4863-496b-a76b-409f3fa4ae18 service nova] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 758.008539] env[65446]: INFO networking_nsxv3.common.synchronization [req-c7d5d8cb-4584-4b64-98dc-461a5ccd1124 req-d4275331-4863-496b-a76b-409f3fa4ae18 service nova] Enqueued Resource ID: 199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 with Priority: HIGHEST for action port [ 758.009120] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_rules [ 758.009383] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 758.009599] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 with Priority: HIGHEST for action port [ 758.009932] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.010150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.010260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.010584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.010724] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.012108] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.012239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.013249] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.013400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.013522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.013664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.013729] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('199ed3cd-a14e-42b1-8e93-a4bb347ee9d2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.164817] env[65446]: INFO networking_nsxv3.common.synchronization [None req-3b4475d6-6b05-42d1-89b3-c826d94f1c2b tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 758.165275] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 758.165435] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.165685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.165685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.165897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.166016] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.182610] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.182746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.182746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.182951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.183129] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.183268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.183322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.183637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.183845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.183917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.185182] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.185277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.185277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.185440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.185583] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.185674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.185750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.185907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.185982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.186074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.186168] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.516621] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.516819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.518530] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 with status ACTIVE [ 758.518530] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.518639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.518639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.518827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.518941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.519183] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.519288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.519333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.519544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.519627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.519853] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.519974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.520049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.520197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.520300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.520415] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 199ed3cd-a14e-42b1-8e93-a4bb347ee9d2 is going to be updated. [ 758.522535] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d58a4bc7-b80d-4079-8053-d239266e77ed tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 758.523211] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 758.524026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.524135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.552773] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.552964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.553046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.553293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.553434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.553623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-199ed3cd-a14e-42b1-8e93-a4bb347ee9d2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.690609] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24: rpc.has_security_group_logging(os_id): False [ 758.694636] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.694636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.694883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.695094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.695239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.695380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 already deleted. [ 758.695521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.695791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.696051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.696152] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.723273] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.723595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.723595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.723864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.724312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.724312] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.724440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.724440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.724636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.725488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.725488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.725488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.725488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.725488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.725488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.725798] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.725798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.725897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.726162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.726162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.726162] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be updated. [ 758.769452] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4745b7ef-aa36-4e65-8add-9ec2c1c32370 None None] Enqueued Resource ID: 8fd99b53-03f8-47ac-bf58-5b612087be6f with Priority: HIGHEST for action port [ 758.770326] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fd99b53-03f8-47ac-bf58-5b612087be6f with Priority: HIGHEST for action port [ 758.770780] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fd99b53-03f8-47ac-bf58-5b612087be6f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.770960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fd99b53-03f8-47ac-bf58-5b612087be6f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.771091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fd99b53-03f8-47ac-bf58-5b612087be6f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.771476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fd99b53-03f8-47ac-bf58-5b612087be6f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.771604] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fd99b53-03f8-47ac-bf58-5b612087be6f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.851995] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.852193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.852239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.852484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.852642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.855846] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 758.856101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.887103] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 759.221178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.221466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.221466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.221605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.221695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.221797] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 already deleted. [ 759.221877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.274470] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fd99b53-03f8-47ac-bf58-5b612087be6f [ 759.275464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.275464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.275464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.275464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.275464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.275464] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fd99b53-03f8-47ac-bf58-5b612087be6f already deleted. [ 759.275464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fd99b53-03f8-47ac-bf58-5b612087be6f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.713879] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 759.716024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.716024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.716024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.716024] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.716024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.716024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.716024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.716024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.716024] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.221444] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.267897] env[65446]: INFO networking_nsxv3.common.synchronization [None req-24eefb40-5065-4b5b-ad51-dfcb4dc15eec None None] Enqueued Resource ID: 2831ce12-ffa0-4801-ba22-3fe66e097f25 with Priority: HIGHEST for action port [ 760.268440] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2831ce12-ffa0-4801-ba22-3fe66e097f25 with Priority: HIGHEST for action port [ 760.268742] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2831ce12-ffa0-4801-ba22-3fe66e097f25 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.268861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2831ce12-ffa0-4801-ba22-3fe66e097f25" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.268926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2831ce12-ffa0-4801-ba22-3fe66e097f25" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.270365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2831ce12-ffa0-4801-ba22-3fe66e097f25" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.270451] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2831ce12-ffa0-4801-ba22-3fe66e097f25',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.724212] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.773663] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2831ce12-ffa0-4801-ba22-3fe66e097f25 [ 760.773962] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.774110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.774177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.776185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.776185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.776185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2831ce12-ffa0-4801-ba22-3fe66e097f25 already deleted. [ 760.776185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2831ce12-ffa0-4801-ba22-3fe66e097f25" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.901636] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 760.901891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.228873] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.228873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.228873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.228873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.228873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.229771] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be updated. [ 761.278116] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.278285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.278353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.278663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.278701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.291834] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: IN_PROGRESS for 2s [ 761.944646] env[65446]: INFO networking_nsxv3.common.synchronization [None req-44ae6b5b-0156-49f3-a48d-0a23f7271f9f None None] Enqueued Resource ID: c15ba0f5-2dbf-44db-8b9d-d792b852294c with Priority: HIGHEST for action port [ 761.944646] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c15ba0f5-2dbf-44db-8b9d-d792b852294c with Priority: HIGHEST for action port [ 761.944646] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c15ba0f5-2dbf-44db-8b9d-d792b852294c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.944646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c15ba0f5-2dbf-44db-8b9d-d792b852294c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.944646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c15ba0f5-2dbf-44db-8b9d-d792b852294c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.944646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c15ba0f5-2dbf-44db-8b9d-d792b852294c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.944646] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c15ba0f5-2dbf-44db-8b9d-d792b852294c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.449182] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c15ba0f5-2dbf-44db-8b9d-d792b852294c [ 762.449487] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.449560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.449599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.449824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.449930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.450596] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c15ba0f5-2dbf-44db-8b9d-d792b852294c already deleted. [ 762.450596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c15ba0f5-2dbf-44db-8b9d-d792b852294c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.583112] env[65446]: INFO networking_nsxv3.common.synchronization [None req-266b2021-dbd7-402d-a671-839f3a83c317 None None] Enqueued Resource ID: a354787e-9f2d-4d93-b526-57cf4f2c81cf with Priority: HIGHEST for action port [ 762.583112] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a354787e-9f2d-4d93-b526-57cf4f2c81cf with Priority: HIGHEST for action port [ 762.583495] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a354787e-9f2d-4d93-b526-57cf4f2c81cf taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.585989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a354787e-9f2d-4d93-b526-57cf4f2c81cf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.585989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a354787e-9f2d-4d93-b526-57cf4f2c81cf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.585989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a354787e-9f2d-4d93-b526-57cf4f2c81cf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.585989] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a354787e-9f2d-4d93-b526-57cf4f2c81cf',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.087489] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a354787e-9f2d-4d93-b526-57cf4f2c81cf [ 763.087748] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.087889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.087959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.088223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.088309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.088407] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a354787e-9f2d-4d93-b526-57cf4f2c81cf already deleted. [ 763.088510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a354787e-9f2d-4d93-b526-57cf4f2c81cf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.334253] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 763.334656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.334963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.335403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.335568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.335747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.335925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.336312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.336446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.336585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.336731] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.839496] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.839795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.839795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.839975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.840170] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.840278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.840327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.840477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.840564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.840653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.840801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.840894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.840955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.841108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.841257] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.841353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.841413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.841599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.841712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.841821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.841926] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.345719] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b40223d-d70d-4f9e-8923-817eac1b52f3: rpc.has_security_group_logging(os_id): False [ 764.371654] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.371868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.371868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.372132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.372230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.372488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.372600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.372659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.372859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.372932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.373515] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.373515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.373515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.373515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.373515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.373886] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.373886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.374044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.376402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.376402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.376402] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be updated. [ 764.477849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.478183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.478274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.478524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.478683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.494681] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: IN_PROGRESS for 2s [ 765.440583] env[65446]: INFO networking_nsxv3.common.synchronization [req-8bb2543e-f13c-4eb9-87f2-5fbbed6d426f req-7a263fe2-afa9-4154-a373-d14b7714a631 tempest-ServersAdminNegativeTestJSON-1179735760 tempest-ServersAdminNegativeTestJSON-1179735760-project-member] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 765.441307] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGHEST for action security_group_members [ 765.441724] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.441899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.441985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.442521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.442750] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.442925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.443040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.443175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.443277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.443352] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.948042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.948042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.948042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.948042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.948469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.948469] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.948595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.948685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.948931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.949551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.949551] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be updated. [ 765.983396] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.983634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.983680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.984049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.984215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.996877] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: IN_PROGRESS for 2s [ 766.512556] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 766.512880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.596024] env[65446]: INFO networking_nsxv3.common.synchronization [req-2722a9a7-35f9-4221-b634-3c5fb2df0da9 req-0cc73a53-8cb5-4e27-8156-ebb63529374c tempest-ServersWithSpecificFlavorTestJSON-599263955 tempest-ServersWithSpecificFlavorTestJSON-599263955-project-member] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 766.596888] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 766.597266] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.597393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.597457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.597666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.597826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.597922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.597976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.598148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.598232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.598322] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.101299] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.101531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.102127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.102127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.102127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.102837] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.102837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.102837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.103195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.103195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.103195] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 is going to be updated. [ 767.154838] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.154838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.154838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.155038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.155132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.159400] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.159578] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.159702] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.159982] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.160267] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.160425] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.160540] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.160757] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.160900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.161113] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.161226] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.161333] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.161442] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.161548] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.161651] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.161782] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.171236] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: IN_PROGRESS for 2s [ 767.181946] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.182210] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.182301] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.182427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-602" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.182746] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-902f4709-0a6b-4a60-bb74-bc53cf87944f taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.182954] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.183045] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.183368] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.183502] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('902f4709-0a6b-4a60-bb74-bc53cf87944f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.605760] env[65446]: INFO networking_nsxv3.common.synchronization [req-09550f22-9a5c-484a-b408-cd9c58f1481a req-1c43aa98-5048-4b09-a663-e43f3fc83f98 tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 767.606373] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 767.606782] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.606934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.607033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.607357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.607653] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.607725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.607762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.607926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.607998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.608116] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.685611] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.685850] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.685981] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.686291] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.686434] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.686579] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 902f4709-0a6b-4a60-bb74-bc53cf87944f not found, creating... [ 767.686856] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.687012] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.687140] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.687349] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.687477] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.687749] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.687899] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.688013] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.688377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.688377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.688516] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 902f4709-0a6b-4a60-bb74-bc53cf87944f is going to be created. [ 767.711821] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.712406] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.712406] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.712833] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.713153] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.713397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.832684] env[65446]: INFO networking_nsxv3.common.synchronization [req-09550f22-9a5c-484a-b408-cd9c58f1481a req-93814102-a812-4503-a337-a0584f2f84fc tempest-ServersTestMultiNic-328116340 tempest-ServersTestMultiNic-328116340-project-member] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 767.833579] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGHEST for action security_group_members [ 767.834108] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.834239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.009070] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56ef744e-edae-484b-8821-4f332fd192db in Status: SUCCESS [ 768.009358] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56ef744e-edae-484b-8821-4f332fd192db deletion is rescheduled due to dependency. [ 768.009526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.110927] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.462443] env[65446]: INFO networking_nsxv3.common.synchronization [req-2722a9a7-35f9-4221-b634-3c5fb2df0da9 req-ec1b9060-f500-43f6-ba8c-e7a218136ba2 service nova] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 768.462443] env[65446]: INFO networking_nsxv3.common.synchronization [req-2722a9a7-35f9-4221-b634-3c5fb2df0da9 req-ec1b9060-f500-43f6-ba8c-e7a218136ba2 service nova] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 768.462443] env[65446]: INFO networking_nsxv3.common.synchronization [req-2722a9a7-35f9-4221-b634-3c5fb2df0da9 req-ec1b9060-f500-43f6-ba8c-e7a218136ba2 service nova] Enqueued Resource ID: 902f4709-0a6b-4a60-bb74-bc53cf87944f with Priority: HIGHEST for action port [ 768.463622] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_rules [ 768.463832] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 768.464049] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 902f4709-0a6b-4a60-bb74-bc53cf87944f with Priority: HIGHEST for action port [ 768.464690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.464857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.464951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.465191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.465415] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.466531] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.466619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.466870] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-902f4709-0a6b-4a60-bb74-bc53cf87944f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.467016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.467178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.467384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.467493] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('902f4709-0a6b-4a60-bb74-bc53cf87944f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.615130] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.970991] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.972574] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 902f4709-0a6b-4a60-bb74-bc53cf87944f with status ACTIVE [ 768.972574] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.972574] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.972574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.973152] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.973152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.973152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.973152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.973152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.973152] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 902f4709-0a6b-4a60-bb74-bc53cf87944f is going to be updated. [ 768.997746] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.998038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.998038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.998151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.998287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.998429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-902f4709-0a6b-4a60-bb74-bc53cf87944f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.118383] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.118383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.118383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.118383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.118693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.118693] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 769.162811] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.162968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.163190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.163240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.163397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.179045] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 769.184041] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: SUCCESS [ 769.184041] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 deletion is rescheduled due to dependency. [ 769.184171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.184890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.184890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.184890] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.184890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.184890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.185274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.185274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.185274] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.688792] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.192436] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.697655] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.698013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.698013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.698612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.698702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.698860] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 is going to be updated. [ 770.735238] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.735487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.735590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.736227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.736227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.747264] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: IN_PROGRESS for 2s [ 770.987997] env[65446]: INFO networking_nsxv3.common.synchronization [req-5f371b0f-32fb-4384-bb1e-dc6781e29368 req-6f6ca654-9d22-457e-a2e3-602a988b353b tempest-VolumesAssistedSnapshotsTest-973014014 tempest-VolumesAssistedSnapshotsTest-973014014-project-member] Enqueued Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_members [ 770.990079] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGHEST for action security_group_members [ 770.990639] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.990876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.990940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.991256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.991543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.991678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.991743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.991991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.992173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.992345] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.192023] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 771.192023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.192023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.192023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.192023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.192023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.192437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.192437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.192437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.192437] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.497495] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.497495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.497495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.497495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.499933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.500281] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.500477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.500526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.500701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.500785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.500876] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 is going to be updated. [ 771.539533] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.539689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.539773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.539971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.540153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.550822] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 in Status: IN_PROGRESS for 2s [ 771.696864] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.696864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.696864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.696864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.697113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.697224] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.697327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.697697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.697697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.697697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.697697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be updated. [ 771.729482] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.729621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.729689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.729908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.730058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.742194] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: IN_PROGRESS for 2s [ 772.758883] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: SUCCESS [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.761958] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.761958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.761958] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.265928] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.561334] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 in Status: SUCCESS [ 773.561334] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 deletion is rescheduled due to dependency. [ 773.561334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.754236] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fba5fede-4e1d-4734-bb87-51495f4aff23 in Status: SUCCESS [ 773.754236] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 deletion is rescheduled due to dependency. [ 773.754447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.769892] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73f89999-ebe2-4491-b7a9-a88502cfe139: rpc.has_security_group_logging(os_id): False [ 773.799637] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.799840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.799896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.800262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.800379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.802552] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.802552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.802552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.802552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.802552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.802552] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 is going to be updated. [ 773.935272] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.935735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.936814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.939940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.939940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.961249] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: IN_PROGRESS for 2s [ 774.294305] env[65446]: INFO networking_nsxv3.common.synchronization [req-ac336e3e-2e5f-4bb7-a307-c8f75407cc49 req-d5ee12b9-9f89-4373-918b-52e68704d330 tempest-ListImageFiltersTestJSON-2060955957 tempest-ListImageFiltersTestJSON-2060955957-project-member] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 774.294754] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 774.295086] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.295218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.295284] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.295488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.295645] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.295745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.295810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.296043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.296138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.296237] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.801430] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.305091] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.561984] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 775.562214] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:1 started [ 775.807464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.807819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.807819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.807979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.808091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.808199] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be updated. [ 775.843033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.843033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.843033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.843291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.843291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.855046] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: IN_PROGRESS for 2s [ 775.977592] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: SUCCESS [ 775.977818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.867445] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: SUCCESS [ 777.868836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.539449] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9decdd98-64ac-44c8-b13a-090b9f0617ad None None] Enqueued Resource ID: 990ced79-f205-4bcb-bff3-67e854da1374 with Priority: HIGHEST for action port [ 778.539449] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 990ced79-f205-4bcb-bff3-67e854da1374 with Priority: HIGHEST for action port [ 778.539449] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-990ced79-f205-4bcb-bff3-67e854da1374 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.539449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-990ced79-f205-4bcb-bff3-67e854da1374" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.539449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-990ced79-f205-4bcb-bff3-67e854da1374" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.539707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-990ced79-f205-4bcb-bff3-67e854da1374" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.539861] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('990ced79-f205-4bcb-bff3-67e854da1374',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.045031] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 990ced79-f205-4bcb-bff3-67e854da1374 [ 779.045031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.045031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.045031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.045031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.045031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.045031] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:990ced79-f205-4bcb-bff3-67e854da1374 already deleted. [ 779.045031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-990ced79-f205-4bcb-bff3-67e854da1374" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.741358] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-44d95d05-f57b-4bd5-8c23-ab25499953de tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 779.742142] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 779.742465] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.743140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.743140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.743140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.743140] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.743345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.743345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.743410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.744174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.744174] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.155257] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.155257] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.155257] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.155257] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.155732] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.155732] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.155732] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.155985] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.156175] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.156420] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.156994] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.156994] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.156994] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.156994] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.156994] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.157254] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.178622] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.178837] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.179020] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.179235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.179728] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-b168e124-d1d3-4d2e-b010-a970c10b691d taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.179728] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.179888] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.180239] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.180381] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b168e124-d1d3-4d2e-b010-a970c10b691d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.245342] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.245505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.245576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.245795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.246117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.246444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.246444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.246548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.246670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.246752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.246844] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 780.277423] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.277423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.277423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.277423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.277423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.290210] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 780.682416] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.683731] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.683731] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.683939] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.684110] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.684271] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port b168e124-d1d3-4d2e-b010-a970c10b691d not found, creating... [ 780.684889] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.685134] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.685298] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.685572] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.686022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.686440] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.686616] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.686782] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.686964] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.687378] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.687681] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: b168e124-d1d3-4d2e-b010-a970c10b691d is going to be created. [ 780.711808] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.712058] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.712370] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.712542] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.712772] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.713009] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.758555] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9f45d520-f203-4709-b393-b8263bedc4be None None] Enqueued Resource ID: 326c2ec8-d9f8-4c01-9bef-cf23bbf9af34 with Priority: HIGHEST for action port [ 780.759318] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326c2ec8-d9f8-4c01-9bef-cf23bbf9af34 with Priority: HIGHEST for action port [ 780.759453] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-326c2ec8-d9f8-4c01-9bef-cf23bbf9af34 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.760041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-326c2ec8-d9f8-4c01-9bef-cf23bbf9af34" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.760041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-326c2ec8-d9f8-4c01-9bef-cf23bbf9af34" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.760041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-326c2ec8-d9f8-4c01-9bef-cf23bbf9af34" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.760041] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326c2ec8-d9f8-4c01-9bef-cf23bbf9af34',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.263527] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 326c2ec8-d9f8-4c01-9bef-cf23bbf9af34 [ 781.263814] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.263932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.263995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.264308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.264422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.264568] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:326c2ec8-d9f8-4c01-9bef-cf23bbf9af34 already deleted. [ 781.264658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-326c2ec8-d9f8-4c01-9bef-cf23bbf9af34" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.473427] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-7f8fd1f6-35c6-44e4-9c94-344fa44faa28 service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 781.473427] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-7f8fd1f6-35c6-44e4-9c94-344fa44faa28 service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 781.473427] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-7f8fd1f6-35c6-44e4-9c94-344fa44faa28 service nova] Enqueued Resource ID: b168e124-d1d3-4d2e-b010-a970c10b691d with Priority: HIGHEST for action port [ 781.473539] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 781.473632] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 781.475135] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b168e124-d1d3-4d2e-b010-a970c10b691d with Priority: HIGHEST for action port [ 781.475400] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.475528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.475594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.475795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.475877] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.476813] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.476899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.477351] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b168e124-d1d3-4d2e-b010-a970c10b691d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.477351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.477351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.478228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.478228] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b168e124-d1d3-4d2e-b010-a970c10b691d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.979356] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.979551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.979839] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b168e124-d1d3-4d2e-b010-a970c10b691d with status ACTIVE [ 781.980037] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.980307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.980307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.980959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.980959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.980959] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.981132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.981225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.981387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.982106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.982564] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.982564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.985247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.985247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.985247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.985247] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b168e124-d1d3-4d2e-b010-a970c10b691d is going to be updated. [ 782.008258] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.008258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.008258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.008258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.008258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.008799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b168e124-d1d3-4d2e-b010-a970c10b691d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.086704] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e85a3cc1-af4d-4541-8e7a-5dcf9d8fb19c tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: 6508b350-88fd-4d24-9993-03f54d5504c7 with Priority: HIGHEST for action security_group_rules [ 782.086704] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6508b350-88fd-4d24-9993-03f54d5504c7 with Priority: HIGHEST for action security_group_rules [ 782.086922] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6508b350-88fd-4d24-9993-03f54d5504c7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.087090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.087090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.087757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.087757] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6508b350-88fd-4d24-9993-03f54d5504c7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.186392] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c468a24e-6be9-431d-9565-2b7e737a7cc2 tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: 6508b350-88fd-4d24-9993-03f54d5504c7 with Priority: HIGHEST for action security_group_rules [ 782.186762] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6508b350-88fd-4d24-9993-03f54d5504c7 with Priority: HIGHEST for action security_group_rules [ 782.187124] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6508b350-88fd-4d24-9993-03f54d5504c7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.187219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.311443] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 782.311743] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 deletion is rescheduled due to dependency. [ 782.312884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.312884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.312884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.312884] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.312884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.312884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.312884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.312884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.313271] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.613339] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.613339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.613339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.613339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.613339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.613339] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6508b350-88fd-4d24-9993-03f54d5504c7 already deleted. [ 782.613339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.613339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.613339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.613339] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6508b350-88fd-4d24-9993-03f54d5504c7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.815509] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.137474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.137654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.137706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.137952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.137952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.138197] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6508b350-88fd-4d24-9993-03f54d5504c7 already deleted. [ 783.138237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6508b350-88fd-4d24-9993-03f54d5504c7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.317959] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.822481] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.822481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.822655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.822988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.823147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.823312] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 783.863506] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.863700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.863777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.864013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.864248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.878134] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 784.563291] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-16231a2c-b7fe-4343-8385-168ace3872e6 tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 784.563945] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 784.564216] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.564305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.905124] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.905324] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.905396] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.905645] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.905897] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.906083] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.906201] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.906432] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.906565] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.906763] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.906869] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.906971] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.907113] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.907223] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.907354] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.907557] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.933632] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.933632] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 784.933632] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.933632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-983" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.933632] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-bf5e7d36-86fc-44c3-b271-c571c41e4277 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.933632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.933632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.934048] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.934200] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5e7d36-86fc-44c3-b271-c571c41e4277',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.438760] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.439471] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.439471] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.439629] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.439665] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.441411] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port bf5e7d36-86fc-44c3-b271-c571c41e4277 not found, creating... [ 785.441411] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.441411] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.441411] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.441411] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.441411] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.441877] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.441877] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.441978] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.442228] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.442390] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.442582] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: bf5e7d36-86fc-44c3-b271-c571c41e4277 is going to be created. [ 785.467194] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.467450] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.467553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.467868] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.468221] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.468693] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.889226] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 785.889226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.889747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.889747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.889937] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.889993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.890077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.890250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.890250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.890347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.890484] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.891298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.891522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.891618] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.891723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.891783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.891918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.892009] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.892212] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.215837] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-839e01f3-d0dc-4fa5-85b2-e1c7f88e2593 service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 786.216049] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-839e01f3-d0dc-4fa5-85b2-e1c7f88e2593 service nova] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 786.216190] env[65446]: INFO networking_nsxv3.common.synchronization [req-6bbdb1c1-e9ca-44f6-9ee6-7624ef776de5 req-839e01f3-d0dc-4fa5-85b2-e1c7f88e2593 service nova] Enqueued Resource ID: bf5e7d36-86fc-44c3-b271-c571c41e4277 with Priority: HIGHEST for action port [ 786.216733] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_rules [ 786.216861] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 786.217042] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5e7d36-86fc-44c3-b271-c571c41e4277 with Priority: HIGHEST for action port [ 786.217250] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.217408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.217611] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.217694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.217866] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5e7d36-86fc-44c3-b271-c571c41e4277 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.217976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.218047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.218230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.218303] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5e7d36-86fc-44c3-b271-c571c41e4277',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.394099] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.394240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.394437] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.721014] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf5e7d36-86fc-44c3-b271-c571c41e4277 with status ACTIVE [ 786.721014] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.721014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.721014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.721383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.721383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.721568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.721685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.722250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.722250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.722250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.722250] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.722607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.722607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.722607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.722607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.722827] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf5e7d36-86fc-44c3-b271-c571c41e4277 is going to be updated. [ 786.746342] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.746562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.746695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.747032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.747243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.747493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5e7d36-86fc-44c3-b271-c571c41e4277" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.897227] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.341213] env[65446]: INFO networking_nsxv3.common.synchronization [req-11352152-d140-4b0b-9e60-17b5bfca612f req-f219985a-ef58-4004-ae4d-6fc39d9a03e2 tempest-FloatingIPsAssociationTestJSON-2100177048 tempest-FloatingIPsAssociationTestJSON-2100177048-project-member] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 787.341951] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 787.342309] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.342448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.342520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.342770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.342927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.343039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.343094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.343247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.343368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.343428] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.400225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.401641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.401641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.401641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.401641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.401641] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 787.443466] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.443466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.443466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.443466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.443466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.460144] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 787.738665] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.740024] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.740024] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.740024] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.740024] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.740314] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.740532] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.741067] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.741311] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.744040] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.744040] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.744040] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.744040] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.744040] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.744040] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.744040] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.766607] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.767061] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 787.767677] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.767677] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.767815] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-6e6e13f9-09b7-4db4-9000-a57f130b7806 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.767936] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.768882] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.769164] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.769341] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e6e13f9-09b7-4db4-9000-a57f130b7806',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.847936] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.847936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.847936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.847936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.847936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.847936] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.847936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.847936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.848584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.848584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.848584] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 already deleted. [ 787.848584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.274076] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.274777] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.274777] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.274868] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.275096] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.275243] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 6e6e13f9-09b7-4db4-9000-a57f130b7806 not found, creating... [ 788.275713] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.275977] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.276102] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.276397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.276540] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.276915] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.277103] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.277223] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.277479] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.277615] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.277791] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 6e6e13f9-09b7-4db4-9000-a57f130b7806 is going to be created. [ 788.310311] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.310708] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.310922] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.311869] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.311869] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.312138] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.039015] env[65446]: INFO networking_nsxv3.common.synchronization [req-11352152-d140-4b0b-9e60-17b5bfca612f req-049da0ae-5137-4c85-b2bd-8333d54f8b4e service nova] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_rules [ 789.039212] env[65446]: INFO networking_nsxv3.common.synchronization [req-11352152-d140-4b0b-9e60-17b5bfca612f req-049da0ae-5137-4c85-b2bd-8333d54f8b4e service nova] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 789.039336] env[65446]: INFO networking_nsxv3.common.synchronization [req-11352152-d140-4b0b-9e60-17b5bfca612f req-049da0ae-5137-4c85-b2bd-8333d54f8b4e service nova] Enqueued Resource ID: 6e6e13f9-09b7-4db4-9000-a57f130b7806 with Priority: HIGHEST for action port [ 789.039791] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_rules [ 789.039791] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 789.039791] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e6e13f9-09b7-4db4-9000-a57f130b7806 with Priority: HIGHEST for action port [ 789.040367] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.040691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.040691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.041244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.041244] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.041889] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.042059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.042112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.042308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.042399] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.042500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.042559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.042707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.042787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.045124] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.046161] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e6e13f9-09b7-4db4-9000-a57f130b7806 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.046319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.046499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.046563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.046612] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e6e13f9-09b7-4db4-9000-a57f130b7806',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.469711] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 789.469953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.470269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.470310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.470571] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.470689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.470755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.470941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.471098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.471352] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.548924] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.551565] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.551565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.551565] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e6e13f9-09b7-4db4-9000-a57f130b7806 with status ACTIVE [ 789.551565] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.551565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.551565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.551565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.551565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.552131] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.552131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.552131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.552131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.552335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.553029] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.553029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.553029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.553029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.553029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.553029] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e6e13f9-09b7-4db4-9000-a57f130b7806 is going to be updated. [ 789.579082] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.579369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.579510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.579879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.580158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.580474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e6e13f9-09b7-4db4-9000-a57f130b7806" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.973611] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.056426] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.108476] env[65446]: INFO networking_nsxv3.common.synchronization [req-11e4147a-5c82-4a85-8e79-a12eecc4ea23 req-b462abf9-e7b2-40ec-8445-07606ae25985 tempest-ServersTestBootFromVolume-2126361038 tempest-ServersTestBootFromVolume-2126361038-project-member] Enqueued Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_members [ 790.109244] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_members [ 790.109575] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.109707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.109770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.110611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.110611] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.110611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.110611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.110611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.110611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.110888] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.476286] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.530268] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.530268] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-852" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.530268] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-852" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.530268] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-852" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.530268] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.530759] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.531102] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.531843] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.534819] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.534819] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.534819] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.534819] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.534819] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.534819] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.534819] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.534819] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.556040] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.556040] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.556040] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.556040] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-852" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.556040] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-bf40462b-d6f7-4aad-8a34-9a05017ed379 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.556040] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.556040] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.556040] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.556040] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf40462b-d6f7-4aad-8a34-9a05017ed379',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.558864] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.558864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.558864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.558864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.559144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.559144] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be created. [ 790.585709] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.585709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.585709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.585709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.586128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.599251] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: UNINITIALIZED for 2s [ 790.613729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.614415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.614415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.614415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.614415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.614415] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.614610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.614610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.614744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.614787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.614930] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 already deleted. [ 790.614989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.979766] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.979982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.980049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.980291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.980379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.980510] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 791.015656] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.015656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.015656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.015656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.015656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.024809] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 791.065050] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.065050] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port bf40462b-d6f7-4aad-8a34-9a05017ed379 not found, creating... [ 791.065050] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.065050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.065449] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.065449] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.065449] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.065449] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.065449] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.065449] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: bf40462b-d6f7-4aad-8a34-9a05017ed379 is going to be created. [ 791.096405] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.096751] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.096947] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.097286] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.100429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.100734] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.838825] env[65446]: INFO networking_nsxv3.common.synchronization [req-11e4147a-5c82-4a85-8e79-a12eecc4ea23 req-5dc8f120-e9d0-4a9c-b4e7-e710f0d6d051 service nova] Enqueued Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_rules [ 791.838825] env[65446]: INFO networking_nsxv3.common.synchronization [req-11e4147a-5c82-4a85-8e79-a12eecc4ea23 req-5dc8f120-e9d0-4a9c-b4e7-e710f0d6d051 service nova] Enqueued Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_members [ 791.838825] env[65446]: INFO networking_nsxv3.common.synchronization [req-11e4147a-5c82-4a85-8e79-a12eecc4ea23 req-5dc8f120-e9d0-4a9c-b4e7-e710f0d6d051 service nova] Enqueued Resource ID: bf40462b-d6f7-4aad-8a34-9a05017ed379 with Priority: HIGHEST for action port [ 791.838825] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_rules [ 791.838825] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_members [ 791.838825] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf40462b-d6f7-4aad-8a34-9a05017ed379 with Priority: HIGHEST for action port [ 791.838825] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.838825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.838825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.838825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.838825] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.839849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.840760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.840760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.840760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.840760] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.840760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.840760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.841284] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.841284] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.841284] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.844091] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf40462b-d6f7-4aad-8a34-9a05017ed379 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.844091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.844091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.844091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.844091] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf40462b-d6f7-4aad-8a34-9a05017ed379',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.342746] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.343969] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf40462b-d6f7-4aad-8a34-9a05017ed379 with status ACTIVE [ 792.344268] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.344485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.344637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.344923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.345057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.345269] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.345404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.345537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.345655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.345727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.345998] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.346225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.346466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.346466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.346568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.346617] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf40462b-d6f7-4aad-8a34-9a05017ed379 is going to be updated. [ 792.348044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.348717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.386822] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.387073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.387157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.387372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.387499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.387665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf40462b-d6f7-4aad-8a34-9a05017ed379" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.615022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: SUCCESS [ 792.615161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.615353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.615624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.615840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.615981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.616066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.616278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.616362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.616441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.616551] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.849677] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.955191] env[65446]: INFO networking_nsxv3.common.synchronization [req-a51c111b-b4e3-4f23-ac59-5e0717de501b req-d4d6bccc-e9c7-45be-ad3d-7f7bc5666a6e tempest-ServerTagsTestJSON-65928461 tempest-ServerTagsTestJSON-65928461-project-member] Enqueued Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_members [ 792.955191] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_members [ 792.955191] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.955191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.955191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.956150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.956522] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.956894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.957131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.957589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.957820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.958435] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.035237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 793.035439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.035615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.035888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.036164] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.036328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.036376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.036518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.036601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.036693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.036855] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.036979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.037057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.037222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.037357] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.037454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.037516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.037654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.037728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.037809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.037899] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.123286] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.123485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.123586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.123973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.124224] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.124369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.124445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.124659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.124752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.124863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.125117] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.125241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.125339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.125534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.125728] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.125923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.126098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.130116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.130116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.130116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.130116] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.352448] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.352740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.352858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.353136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.353247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.353365] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 is going to be created. [ 793.385360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.385504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.385625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.385790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.386084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.399075] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 in Status: UNINITIALIZED for 2s [ 793.430212] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.430212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.430212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.430212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.430212] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.430212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.430212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.431047] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.431362] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.431758] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.434027] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.434027] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.434027] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.434027] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.434027] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.434027] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.452443] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.452672] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.452896] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.453278] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.453714] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-2a9a81b9-0814-4d86-b6b7-0679b1a06672 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.454040] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.454166] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.454644] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.454835] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a9a81b9-0814-4d86-b6b7-0679b1a06672',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.461022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.462580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.462708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.463065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.463185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.463397] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.463495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.463555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.463749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.464083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.464083] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71f7450b-5fa7-41f3-864b-864413a78a38 already deleted. [ 793.464083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.540908] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79c30290-ba80-4936-8673-39beeb72a136: rpc.has_security_group_logging(os_id): False [ 793.561343] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.561522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.561613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.561884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.562059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.562324] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.562441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.562508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.562711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.562779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.562974] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.563083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.563158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.563302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.563376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.565977] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.567546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.567983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.568099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.568556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.568556] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 793.633799] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dd34d6e-ba50-47dc-9428-10a867ec77b5: rpc.has_security_group_logging(os_id): False [ 793.642345] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.642345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.642345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.642544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.642544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.652717] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.652934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.653012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.653257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.653349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.653591] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.653699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.653939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.654044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.654732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.654732] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.654732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.655228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.655228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.655307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.655633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.655772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.655853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.656096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.656196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.656288] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be created. [ 793.658975] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 793.779606] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.779837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.779929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.780332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.780613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.818018] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: IN_PROGRESS for 2s [ 793.959728] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.960453] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.960453] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.960680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.960773] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.960953] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 2a9a81b9-0814-4d86-b6b7-0679b1a06672 not found, creating... [ 793.961345] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.961536] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.961714] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.962099] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.962288] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.962692] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.962982] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.963374] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.963703] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.963851] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.964054] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 2a9a81b9-0814-4d86-b6b7-0679b1a06672 is going to be created. [ 793.991828] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.992180] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.992379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.992828] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.993254] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.993569] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.729519] env[65446]: INFO networking_nsxv3.common.synchronization [req-a51c111b-b4e3-4f23-ac59-5e0717de501b req-5f2a0391-d904-45d8-b833-9739487067d4 service nova] Enqueued Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_rules [ 794.729519] env[65446]: INFO networking_nsxv3.common.synchronization [req-a51c111b-b4e3-4f23-ac59-5e0717de501b req-5f2a0391-d904-45d8-b833-9739487067d4 service nova] Enqueued Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_members [ 794.729519] env[65446]: INFO networking_nsxv3.common.synchronization [req-a51c111b-b4e3-4f23-ac59-5e0717de501b req-5f2a0391-d904-45d8-b833-9739487067d4 service nova] Enqueued Resource ID: 2a9a81b9-0814-4d86-b6b7-0679b1a06672 with Priority: HIGHEST for action port [ 794.730247] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_rules [ 794.730247] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_members [ 794.730247] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9a81b9-0814-4d86-b6b7-0679b1a06672 with Priority: HIGHEST for action port [ 794.730501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.730632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.731259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.731259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.731259] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.732092] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.732349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.733081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.733081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.733081] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.733081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.733081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.733081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.733440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.733440] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.733968] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a9a81b9-0814-4d86-b6b7-0679b1a06672 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.734122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.734182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.734301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.734375] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a9a81b9-0814-4d86-b6b7-0679b1a06672',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.236446] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.237796] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.237877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.238047] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a9a81b9-0814-4d86-b6b7-0679b1a06672 with status ACTIVE [ 795.238314] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.238477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.238615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.238846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.238960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.239153] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.239301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.240067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.240067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.240067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.240067] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.240620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.240620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.240620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.240620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.240620] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a9a81b9-0814-4d86-b6b7-0679b1a06672 is going to be updated. [ 795.273031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.273218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.273218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.273916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.273916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.274075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a9a81b9-0814-4d86-b6b7-0679b1a06672" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.414633] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 in Status: SUCCESS [ 795.415085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.415192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.415393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.415588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.415720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.415771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.415910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.416060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.416160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.416314] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.673756] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 795.675033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.675033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.675033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.675033] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.742930] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.829396] env[65446]: INFO networking_nsxv3.common.synchronization [req-9f274b64-2f5c-442c-bacb-322b5014b317 req-48c5d249-b63a-4b15-b6ed-f1be066cda3d tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 795.830071] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 795.830600] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.830791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.830791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.832239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.832239] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.832239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.832239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.832239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.832239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.832239] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.838378] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: SUCCESS [ 795.838378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.921126] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.178851] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.179138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.179262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.179531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.179804] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.179925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.180240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.180433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.180634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.180719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.180785] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.247035] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.247035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.247035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.247035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.247035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.247035] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71f7450b-5fa7-41f3-864b-864413a78a38 is going to be created. [ 796.278411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.279129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.279220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.279487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.279730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.301751] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71f7450b-5fa7-41f3-864b-864413a78a38 in Status: UNINITIALIZED for 2s [ 796.334015] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.334334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.334572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.336573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.336573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.336573] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.336573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.336573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.336573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.336573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.336573] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 already deleted. [ 796.336573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.382431] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.382791] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.382932] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.383286] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.383587] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.383822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.383972] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.384235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.384400] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.384618] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.384772] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.384926] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.385096] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.385189] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.385407] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.385407] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.413355] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.413586] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.413741] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.414174] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.414604] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-04208900-1e4c-437b-9216-97ef6289e73a taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.414842] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.415120] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.415556] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.415703] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04208900-1e4c-437b-9216-97ef6289e73a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.423872] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38fd7db5-286a-40dc-8ccd-267d22d38c03: rpc.has_security_group_logging(os_id): False [ 796.446524] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.446792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.446792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.447244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.447391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.447675] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.447794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.447862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.448050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.448156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.448360] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 is going to be created. [ 796.527460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.527694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.527819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.528103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.528423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.544391] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 in Status: IN_PROGRESS for 2s [ 796.685019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.685019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.685019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.685268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.685428] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.685563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.685630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.685784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.685871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.685964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.686268] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.686385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.686449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.686594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.686737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.686832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.686891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.687037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.687118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.687195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.687287] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.861389] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e5e6f37e-fff7-4c9a-9cf3-29a517dae229 tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_rules [ 796.861928] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_rules [ 796.862255] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.862383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.862441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.862729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.862816] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.920403] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.920403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.920403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.920403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.920403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.920403] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 04208900-1e4c-437b-9216-97ef6289e73a not found, creating... [ 796.920743] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.920804] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.920910] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.921428] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.921428] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.921653] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.921768] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.921855] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.924227] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.924227] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.924227] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 04208900-1e4c-437b-9216-97ef6289e73a is going to be created. [ 796.953354] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.953354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.953354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.953354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.953354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.953825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.049599] env[65446]: INFO networking_nsxv3.common.synchronization [None req-57451e83-d513-449b-ba0c-20af83827771 tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_rules [ 797.050444] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_rules [ 797.050858] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.051038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.189887] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79c30290-ba80-4936-8673-39beeb72a136: rpc.has_security_group_logging(os_id): False [ 797.214465] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.214756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.214756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.215049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.215197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.215591] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.215741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.215815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.216086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.216217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.216468] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.216652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.216758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.216947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.217072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.217299] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.217425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.217518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.217753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.217918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.218651] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 797.312752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.313088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.313088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.313270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.313452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.338037] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 797.397786] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.397786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.397786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.397955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.397955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.398038] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6972103-6289-4c91-918e-1586283726a6 already deleted. [ 797.398093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.398300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.399097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.399097] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.723369] env[65446]: INFO networking_nsxv3.common.synchronization [req-9f274b64-2f5c-442c-bacb-322b5014b317 req-0c9c8b22-021d-4d34-aa51-22eab305dd4e service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 797.723562] env[65446]: INFO networking_nsxv3.common.synchronization [req-9f274b64-2f5c-442c-bacb-322b5014b317 req-0c9c8b22-021d-4d34-aa51-22eab305dd4e service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 797.723737] env[65446]: INFO networking_nsxv3.common.synchronization [req-9f274b64-2f5c-442c-bacb-322b5014b317 req-0c9c8b22-021d-4d34-aa51-22eab305dd4e service nova] Enqueued Resource ID: 04208900-1e4c-437b-9216-97ef6289e73a with Priority: HIGHEST for action port [ 797.727860] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 797.728255] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 797.728570] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04208900-1e4c-437b-9216-97ef6289e73a with Priority: HIGHEST for action port [ 797.729336] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.729481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.729597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.730276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.730276] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.730932] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.731077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.731077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.731355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.731463] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.731573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.731573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.731961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.731961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.731961] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.733469] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-04208900-1e4c-437b-9216-97ef6289e73a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.733469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.733469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.733469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.733469] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04208900-1e4c-437b-9216-97ef6289e73a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.938459] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.938459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.938459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.938459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.938459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.938459] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6972103-6289-4c91-918e-1586283726a6 already deleted. [ 797.938459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.231740] env[65446]: INFO networking_nsxv3.common.synchronization [req-aab2a737-a836-4b4e-bf1e-96bbe0dd6383 req-1df0a881-2175-4fd3-8e07-4a32cca5bfee tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 798.232391] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 798.232719] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.232855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.232962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.233560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.233560] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.233738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.233738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.233996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.234128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.234230] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.236694] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.236763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.237298] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.238560] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04208900-1e4c-437b-9216-97ef6289e73a with status ACTIVE [ 798.238773] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.238896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.238980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.239221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.239497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.239722] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.239844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.239911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.240442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.240442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.240442] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.240604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.240604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.240742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.240840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.240964] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04208900-1e4c-437b-9216-97ef6289e73a is going to be updated. [ 798.275548] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.276539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.276539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.276539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.276539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.276751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04208900-1e4c-437b-9216-97ef6289e73a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.314971] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71f7450b-5fa7-41f3-864b-864413a78a38 in Status: SUCCESS [ 798.315605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.315605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.315605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.315770] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.315853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.315896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.316107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.316222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.316267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.316364] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.557904] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 in Status: SUCCESS [ 798.558165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.737726] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.743383] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.819289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.819453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.819524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.819744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.819927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.820041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.820103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.820250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.820330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.820414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.820622] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.820681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.820722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.820824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.820953] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.821049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.821105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.821234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.821307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.821392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.821839] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.097083] env[65446]: INFO networking_nsxv3.common.synchronization [req-708bcfcf-0711-4e8a-a1a7-ddd8189530da req-588f4930-3068-424f-b976-a71c4f7c768c tempest-MultipleCreateTestJSON-1611016042 tempest-MultipleCreateTestJSON-1611016042-project-member] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 799.099189] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGHEST for action security_group_members [ 799.100051] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.100051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.242063] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.245360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.245551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.245587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.245808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.245954] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be created. [ 799.270561] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.270787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.270864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.271016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.271213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.281754] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: UNINITIALIZED for 2s [ 799.327101] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71f7450b-5fa7-41f3-864b-864413a78a38: rpc.has_security_group_logging(os_id): False [ 799.358113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.358308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.358308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.358498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.358574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.358774] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.358869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.358923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.359092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.359210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.359419] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.359518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.359872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.359872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.359872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.360036] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.360120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.360159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.360275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.360339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.360432] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71f7450b-5fa7-41f3-864b-864413a78a38 is going to be created. [ 799.369395] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 799.369637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.425215] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.427043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.427043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.427043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.427043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.438827] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71f7450b-5fa7-41f3-864b-864413a78a38 in Status: IN_PROGRESS for 2s [ 799.744577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.744742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.744815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.745079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.746237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.746237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 799.775164] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.775764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.775847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.776148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.776303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.785768] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 801.296826] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 801.297215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.297281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.297506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.297666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.297781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.297932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.298034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.298086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.298159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.298254] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.463097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71f7450b-5fa7-41f3-864b-864413a78a38 in Status: SUCCESS [ 801.463414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.796921] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 801.797545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.797545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.797684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.797903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.798070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.798256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.798310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.798424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.798546] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.800185] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.800185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.800185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.800470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.800608] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.800708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.800783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.801000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.801000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.801147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.801227] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.801321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.801381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.801518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.802227] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.802338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.802407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.802726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.802726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.802726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.802847] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.304977] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.305448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.305448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.305614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.305658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.305859] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.305959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.306092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.306303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.306360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.306460] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be updated. [ 802.307671] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857e4e4f-84a2-43c7-870d-f3776015cb13: rpc.has_security_group_logging(os_id): False [ 802.333703] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.333883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.333924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.334183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.334275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.334478] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.334955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.334955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.334955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.334955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.335159] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.335159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.335288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.335352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.335419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.335618] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.335707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.335770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.335914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.335991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.336164] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be created. [ 802.362945] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.363198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.363322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.363600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.363821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.378856] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: IN_PROGRESS for 2s [ 802.434029] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.434029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.434029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.434029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.434029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.452629] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 803.516947] env[65446]: INFO networking_nsxv3.common.synchronization [None req-270bf656-cfc2-4ebe-8c89-71330b72d83a tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_rules [ 803.516947] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_rules [ 803.517365] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.517625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.517625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.517761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.517818] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.743820] env[65446]: INFO networking_nsxv3.common.synchronization [req-58ed95e7-903a-4bdf-9c2c-10e48e95af6d req-8acf52a5-195b-455b-9ca1-ecad2c6d54bb tempest-ServersTestFqdnHostnames-165323879 tempest-ServersTestFqdnHostnames-165323879-project-member] Enqueued Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_members [ 803.744316] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGHEST for action security_group_members [ 803.744630] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.744753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.745403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.745498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.745660] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.745799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.745869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.745988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.746150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.746291] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.919471] env[65446]: INFO networking_nsxv3.common.synchronization [None req-2d59c128-b581-4770-b63e-4bd63829a2f5 tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_rules [ 803.920169] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_rules [ 803.920535] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.920648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.044619] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.044805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.044880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.045142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.045208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.045297] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 already deleted. [ 804.045393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.045570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.045727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.045812] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.250303] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.250465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.250527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.250748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.250839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.251075] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.251178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.251214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.251360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.251437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.251525] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743ab854-8016-4dd1-b444-e671e7099027 is going to be updated. [ 804.281255] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.281400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.281591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.281685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.281829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.291711] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743ab854-8016-4dd1-b444-e671e7099027 in Status: IN_PROGRESS for 2s [ 804.391912] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79c30290-ba80-4936-8673-39beeb72a136 in Status: SUCCESS [ 804.392219] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79c30290-ba80-4936-8673-39beeb72a136 deletion is rescheduled due to dependency. [ 804.392827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.469733] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 804.469863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.573136] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.573797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.573797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.573797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.573797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.573797] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 already deleted. [ 804.574025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.932668] env[65446]: INFO networking_nsxv3.common.synchronization [req-c947320a-1caf-4168-b55a-47866aa88c68 req-ed6b30db-4559-4628-a5ef-c4382884de96 tempest-VolumesAdminNegativeTest-956900489 tempest-VolumesAdminNegativeTest-956900489-project-member] Enqueued Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_members [ 804.933446] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_members [ 804.936025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.936025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.936025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.936025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.936025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.936025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.936025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.936025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.936025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.936025] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.439660] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.439854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.439902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.440137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.440205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.440399] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.440494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.440554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.440696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.440769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.440853] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626b100f-ccfe-47af-8e3f-3368124692b1 already deleted. [ 805.440932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.713126] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.713524] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-926" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.713524] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-926" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.713658] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-926" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.713926] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.714269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.714269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.714405] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.714524] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.714729] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.714832] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.714938] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.715054] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.715198] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.715326] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.715587] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.736869] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.737053] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 805.737186] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.737365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-926" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.737678] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-6ea39258-3ccb-4eed-a72a-61078687391a taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.737855] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.738400] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.738400] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.738529] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea39258-3ccb-4eed-a72a-61078687391a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.958699] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e082f898-201a-498a-9d21-3085c04a8840 None None] Enqueued Resource ID: d8730d42-dd18-4d6b-a479-97788d78d402 with Priority: HIGHEST for action port [ 805.959113] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8730d42-dd18-4d6b-a479-97788d78d402 with Priority: HIGHEST for action port [ 805.959466] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8730d42-dd18-4d6b-a479-97788d78d402 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.959861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8730d42-dd18-4d6b-a479-97788d78d402" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.959861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8730d42-dd18-4d6b-a479-97788d78d402" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.960223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8730d42-dd18-4d6b-a479-97788d78d402" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.960223] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8730d42-dd18-4d6b-a479-97788d78d402',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.241515] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.241772] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.241901] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.242204] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.242352] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.242503] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 6ea39258-3ccb-4eed-a72a-61078687391a not found, creating... [ 806.242763] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.242921] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.243045] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.243260] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.243397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.243669] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.243815] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.243926] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.244174] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.244307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.244442] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 6ea39258-3ccb-4eed-a72a-61078687391a is going to be created. [ 806.264465] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.264706] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.264778] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.265064] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.265295] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.265511] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.303986] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743ab854-8016-4dd1-b444-e671e7099027 in Status: SUCCESS [ 806.304208] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743ab854-8016-4dd1-b444-e671e7099027 deletion is rescheduled due to dependency. [ 806.304339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.462128] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8730d42-dd18-4d6b-a479-97788d78d402 [ 806.462391] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.462529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.462600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.462821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.462908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.463010] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8730d42-dd18-4d6b-a479-97788d78d402 already deleted. [ 806.463094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8730d42-dd18-4d6b-a479-97788d78d402" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.026554] env[65446]: INFO networking_nsxv3.common.synchronization [req-b9d41d23-988a-46e0-805e-60e19dd7b01a req-65ecb036-11fa-4f65-a434-e0c2fd1d595a tempest-ImagesOneServerTestJSON-758744168 tempest-ImagesOneServerTestJSON-758744168-project-member] Enqueued Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_members [ 807.026554] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGHEST for action security_group_members [ 807.026554] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.026554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.026554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.027182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.027182] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.027182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.028308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.028552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.028648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.028786] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.079995] env[65446]: INFO networking_nsxv3.common.synchronization [req-c947320a-1caf-4168-b55a-47866aa88c68 req-4d76f742-4103-48b7-a8eb-115b5a137537 service nova] Enqueued Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_rules [ 807.080181] env[65446]: INFO networking_nsxv3.common.synchronization [req-c947320a-1caf-4168-b55a-47866aa88c68 req-4d76f742-4103-48b7-a8eb-115b5a137537 service nova] Enqueued Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_members [ 807.080318] env[65446]: INFO networking_nsxv3.common.synchronization [req-c947320a-1caf-4168-b55a-47866aa88c68 req-4d76f742-4103-48b7-a8eb-115b5a137537 service nova] Enqueued Resource ID: 6ea39258-3ccb-4eed-a72a-61078687391a with Priority: HIGHEST for action port [ 807.080990] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_rules [ 807.081889] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_members [ 807.082100] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea39258-3ccb-4eed-a72a-61078687391a with Priority: HIGHEST for action port [ 807.082300] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.082420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.082485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.084520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.084669] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.085667] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.085787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.085853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.086050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.086288] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.086406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.086470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.086619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.086704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.087386] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.087892] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ea39258-3ccb-4eed-a72a-61078687391a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.087997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.088224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.088224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.088322] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea39258-3ccb-4eed-a72a-61078687391a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.531759] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.531925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.531995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.532241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.532331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.532532] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.532629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.532684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.532882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.532959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.533055] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 is going to be updated. [ 807.564047] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.564243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.564355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.564483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.564677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.575347] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 in Status: IN_PROGRESS for 2s [ 807.590443] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.590443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.590443] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.593196] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ea39258-3ccb-4eed-a72a-61078687391a with status ACTIVE [ 807.593196] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.593196] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.593196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.593641] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.593641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.593641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.593984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.594179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.594293] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ea39258-3ccb-4eed-a72a-61078687391a is going to be updated. [ 807.619299] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.619299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.619299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.619299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.619539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.619628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ea39258-3ccb-4eed-a72a-61078687391a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.096799] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.459915] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4918d861-843a-4c94-a1f9-21960765537c None None] Enqueued Resource ID: 83e370d9-01e7-4c20-8ff9-c7b3a0167933 with Priority: HIGHEST for action port [ 808.460477] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83e370d9-01e7-4c20-8ff9-c7b3a0167933 with Priority: HIGHEST for action port [ 808.460830] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-83e370d9-01e7-4c20-8ff9-c7b3a0167933 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.461526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83e370d9-01e7-4c20-8ff9-c7b3a0167933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.461614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83e370d9-01e7-4c20-8ff9-c7b3a0167933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.461867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83e370d9-01e7-4c20-8ff9-c7b3a0167933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.461967] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83e370d9-01e7-4c20-8ff9-c7b3a0167933',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.599806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.599986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.600094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.600356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.600672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.600672] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626b100f-ccfe-47af-8e3f-3368124692b1 is going to be created. [ 808.636108] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.636108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.636108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.636108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.636108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.649266] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626b100f-ccfe-47af-8e3f-3368124692b1 in Status: UNINITIALIZED for 2s [ 808.966251] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83e370d9-01e7-4c20-8ff9-c7b3a0167933 [ 808.966251] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.966251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.968168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.968168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.968288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.968338] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83e370d9-01e7-4c20-8ff9-c7b3a0167933 already deleted. [ 808.968400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83e370d9-01e7-4c20-8ff9-c7b3a0167933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.584850] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 in Status: SUCCESS [ 809.585206] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 deletion is rescheduled due to dependency. [ 809.585206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.659698] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626b100f-ccfe-47af-8e3f-3368124692b1 in Status: SUCCESS [ 810.659991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.660109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.660965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.660965] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.660965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.660965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.660965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.661249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.661249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.661317] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.883408] env[65446]: INFO networking_nsxv3.common.synchronization [None req-f0e02193-e521-4904-bd8f-68c6c269aa6d None None] Enqueued Resource ID: 55a9f142-a6af-4a08-81da-12dabaf32b45 with Priority: HIGHEST for action port [ 810.883674] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a9f142-a6af-4a08-81da-12dabaf32b45 with Priority: HIGHEST for action port [ 810.884254] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-55a9f142-a6af-4a08-81da-12dabaf32b45 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.884380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55a9f142-a6af-4a08-81da-12dabaf32b45" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.884448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55a9f142-a6af-4a08-81da-12dabaf32b45" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.884702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55a9f142-a6af-4a08-81da-12dabaf32b45" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.884786] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a9f142-a6af-4a08-81da-12dabaf32b45',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.164752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.164931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.165027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.165280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.165460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.165690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.165690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.165811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.165863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.166097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.166182] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.166353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.166353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.166552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.166715] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.166859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.166932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.167230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.167230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.167336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.167454] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.387596] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55a9f142-a6af-4a08-81da-12dabaf32b45 [ 811.387993] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.388225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.388342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.388672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.388823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.388978] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55a9f142-a6af-4a08-81da-12dabaf32b45 already deleted. [ 811.389135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55a9f142-a6af-4a08-81da-12dabaf32b45" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.673604] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 626b100f-ccfe-47af-8e3f-3368124692b1: rpc.has_security_group_logging(os_id): False [ 811.692448] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.692448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.692448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.692819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.692819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.692819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.692932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.692932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.693089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.693165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.693383] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.693507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.693547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.693796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.693796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.693953] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.694103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.694172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.694326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.694638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.694638] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 626b100f-ccfe-47af-8e3f-3368124692b1 is going to be created. [ 811.755769] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.755910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.755979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.756316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.756493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.770460] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 626b100f-ccfe-47af-8e3f-3368124692b1 in Status: IN_PROGRESS for 2s [ 813.796933] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 626b100f-ccfe-47af-8e3f-3368124692b1 in Status: SUCCESS [ 813.797231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.111705] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c0ec7cf5-f57d-42d1-9eea-7b800f034952 None None] Enqueued Resource ID: a6b1307b-8bbd-4018-b97e-13bc6a248c47 with Priority: HIGHEST for action port [ 814.112915] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b1307b-8bbd-4018-b97e-13bc6a248c47 with Priority: HIGHEST for action port [ 814.113210] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6b1307b-8bbd-4018-b97e-13bc6a248c47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.113356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6b1307b-8bbd-4018-b97e-13bc6a248c47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.113428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6b1307b-8bbd-4018-b97e-13bc6a248c47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.113716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6b1307b-8bbd-4018-b97e-13bc6a248c47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.113799] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6b1307b-8bbd-4018-b97e-13bc6a248c47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.615789] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6b1307b-8bbd-4018-b97e-13bc6a248c47 [ 814.616495] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.616495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.616495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.616495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.616495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.616758] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6b1307b-8bbd-4018-b97e-13bc6a248c47 already deleted. [ 814.616758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6b1307b-8bbd-4018-b97e-13bc6a248c47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.995573] env[65446]: INFO networking_nsxv3.common.synchronization [req-d49f6f9c-66cc-49f5-9f34-9b69337644c2 req-ba65fed9-1275-44db-bc6f-03644383f765 tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 815.996119] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 815.996452] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.996579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.996656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.000035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.000035] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.000035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.000035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.000035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.000035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.000035] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.405253] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.405410] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.405819] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.405819] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.405992] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.406182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.406407] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.406835] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.406835] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.406835] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.406947] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.407037] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.407140] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.407742] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.407742] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.407742] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.429352] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.429517] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.429656] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.429824] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.430178] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-80ace484-ead6-476a-a6f8-57f7ff46843e taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.430402] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.430533] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.431250] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.431250] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80ace484-ead6-476a-a6f8-57f7ff46843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.505910] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.772298] env[65446]: INFO networking_nsxv3.common.synchronization [req-74b74b4a-0cfc-42ec-9f86-9d85352e57b6 req-d14a3db4-d1cf-4eb3-aba4-4c3d5ef55c5c tempest-ListImageFiltersTestJSON-2060955957 tempest-ListImageFiltersTestJSON-2060955957-project-member] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 816.772848] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGHEST for action security_group_members [ 816.773164] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.773301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.773365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.773545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.773694] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.773789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.773845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.773988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.774130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.774466] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.934743] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.934976] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.935133] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.935440] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.935603] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.935771] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 80ace484-ead6-476a-a6f8-57f7ff46843e not found, creating... [ 816.936055] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.936325] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.936448] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.936677] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.936819] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.937112] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.937266] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.937381] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.937582] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.937724] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.937933] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 80ace484-ead6-476a-a6f8-57f7ff46843e is going to be created. [ 816.962941] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.963184] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.963387] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.963683] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.963994] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.964283] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.010202] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.276489] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.276659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.276758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.276948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.277087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.277330] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.277463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.277536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.277689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.278255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.278382] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be updated. [ 817.309763] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.309908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.309980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.310217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.310363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.319433] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: IN_PROGRESS for 2s [ 817.512870] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.513067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.513138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.513469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.513555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.513662] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 817.547684] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.547933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.548042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.548280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.548547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.560727] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 817.692437] env[65446]: INFO networking_nsxv3.common.synchronization [req-d49f6f9c-66cc-49f5-9f34-9b69337644c2 req-27202390-d429-48ce-8296-104d23531236 service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 817.692612] env[65446]: INFO networking_nsxv3.common.synchronization [req-d49f6f9c-66cc-49f5-9f34-9b69337644c2 req-27202390-d429-48ce-8296-104d23531236 service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 817.692744] env[65446]: INFO networking_nsxv3.common.synchronization [req-d49f6f9c-66cc-49f5-9f34-9b69337644c2 req-27202390-d429-48ce-8296-104d23531236 service nova] Enqueued Resource ID: 80ace484-ead6-476a-a6f8-57f7ff46843e with Priority: HIGHEST for action port [ 817.692974] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 817.693136] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 817.693243] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80ace484-ead6-476a-a6f8-57f7ff46843e with Priority: HIGHEST for action port [ 817.693785] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.693909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.694577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.694810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.694897] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.695758] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.695859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.696078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-80ace484-ead6-476a-a6f8-57f7ff46843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.696240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.696296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.696448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.696525] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80ace484-ead6-476a-a6f8-57f7ff46843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.199684] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.199936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.200100] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80ace484-ead6-476a-a6f8-57f7ff46843e with status ACTIVE [ 818.200282] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.200460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.200460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.200789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.200846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.201057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.201194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.201276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.201545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.201545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.201739] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.201857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.201936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.202119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.202285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.202335] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80ace484-ead6-476a-a6f8-57f7ff46843e is going to be updated. [ 818.231481] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.231481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.231481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.231481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.231481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.231481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80ace484-ead6-476a-a6f8-57f7ff46843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.604834] env[65446]: INFO networking_nsxv3.common.synchronization [req-43ba1aeb-3dc8-4e67-9302-0b0d566521ba req-3d6926d6-a804-4024-a1cd-f45eeb0485ab tempest-ServerRescueTestJSON-779930602 tempest-ServerRescueTestJSON-779930602-project-member] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 818.605477] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 818.605785] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.605907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.605995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.606578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.606832] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.607015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.608071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.608071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.608227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.608367] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.005926] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-874 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.006195] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.006364] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.006733] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.007452] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.007632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.007752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.008011] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.008263] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.008487] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.009146] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.009146] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.009146] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.009146] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.009146] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.009394] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.032860] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.033130] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.033355] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.033583] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.034281] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-fafcd9d3-82e7-495b-9b1a-1be15cd639be taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.034281] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.034498] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.034717] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.034849] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fafcd9d3-82e7-495b-9b1a-1be15cd639be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.111312] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.111553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.111804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.111918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.112023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.112223] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.112393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.112393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.112527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.113032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.113032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 already deleted. [ 819.113032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.330044] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0365110-9ded-49bd-a10e-2a106e2db350 in Status: SUCCESS [ 819.331349] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 deletion is rescheduled due to dependency. [ 819.331579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.540426] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.540808] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.540960] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.541405] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.541755] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.541871] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port fafcd9d3-82e7-495b-9b1a-1be15cd639be not found, creating... [ 819.542318] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.542723] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.542723] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.542972] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.543338] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.543763] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.543985] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.544278] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.544465] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.544790] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.544871] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: fafcd9d3-82e7-495b-9b1a-1be15cd639be is going to be created. [ 819.570675] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 819.571010] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.571263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.571572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.571847] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.572045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.572152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.572388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.572512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.572651] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.575111] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.575309] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.575432] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.575670] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.575886] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.576340] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.079783] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.312016] env[65446]: INFO networking_nsxv3.common.synchronization [req-43ba1aeb-3dc8-4e67-9302-0b0d566521ba req-da6fa1ff-a7a8-446c-ba70-e187b55dfb90 service nova] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_rules [ 820.312203] env[65446]: INFO networking_nsxv3.common.synchronization [req-43ba1aeb-3dc8-4e67-9302-0b0d566521ba req-da6fa1ff-a7a8-446c-ba70-e187b55dfb90 service nova] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 820.312473] env[65446]: INFO networking_nsxv3.common.synchronization [req-43ba1aeb-3dc8-4e67-9302-0b0d566521ba req-da6fa1ff-a7a8-446c-ba70-e187b55dfb90 service nova] Enqueued Resource ID: fafcd9d3-82e7-495b-9b1a-1be15cd639be with Priority: HIGHEST for action port [ 820.313042] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_rules [ 820.313425] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 820.313425] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fafcd9d3-82e7-495b-9b1a-1be15cd639be with Priority: HIGHEST for action port [ 820.313506] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.313615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.313679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.314024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.314076] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.315417] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.315550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.315603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.316716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.316881] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.317204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.317204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.317204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.317501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.317501] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.319643] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fafcd9d3-82e7-495b-9b1a-1be15cd639be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.319643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.319643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.319643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.319945] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fafcd9d3-82e7-495b-9b1a-1be15cd639be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.582269] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.822181] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.822322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.822551] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.823737] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fafcd9d3-82e7-495b-9b1a-1be15cd639be with status ACTIVE [ 820.823935] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.824067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.824157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.824374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.824465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.824708] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.824827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.824891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.825063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.825141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.825541] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.825649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.825713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.825862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.825940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.826034] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fafcd9d3-82e7-495b-9b1a-1be15cd639be is going to be updated. [ 820.854189] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.854189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.854189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.854189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.854189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.854189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fafcd9d3-82e7-495b-9b1a-1be15cd639be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.085970] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.086192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.086405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.086507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.086619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.086696] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 821.127114] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.127305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.127356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.128248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.128248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.140335] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 821.331684] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.379513] env[65446]: INFO networking_nsxv3.common.synchronization [req-a7a79343-4d95-4e3d-b163-2230f8376c71 req-faeda56a-f302-4a70-a244-4bd64fb5d2f7 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 821.380496] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 821.380586] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.381051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.381131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.381419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.381734] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.381926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.381926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.383063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.383063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.383063] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.720606] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.721174] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-803" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.721174] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-803" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.721357] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-803" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.721598] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.721754] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.721871] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.722094] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.722252] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.722425] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.722533] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.722635] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.722736] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.722826] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.722929] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.723065] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.747699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.747876] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.747995] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.748182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-803" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.748641] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-47f71d4a-ae47-4610-a793-414949829704 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.748831] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.748958] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.749313] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.749455] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f71d4a-ae47-4610-a793-414949829704',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.834541] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.834786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.834917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.835239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.835369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.836629] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be created. [ 821.861605] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.861875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.861875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.861992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.862157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.873236] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: UNINITIALIZED for 2s [ 821.885862] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.886169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.886169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.886492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.886581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.886800] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.886922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.886992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.887152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.887308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.887378] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 already deleted. [ 821.887432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.254263] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.254633] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.254756] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.255154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.255401] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.255486] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 47f71d4a-ae47-4610-a793-414949829704 not found, creating... [ 822.255770] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.255923] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.256047] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.256354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.256498] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.259811] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.259811] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.259811] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.259811] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.259811] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.259811] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 47f71d4a-ae47-4610-a793-414949829704 is going to be created. [ 822.282397] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.282649] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.282778] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.283056] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.283281] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.283542] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.058244] env[65446]: INFO networking_nsxv3.common.synchronization [req-a7a79343-4d95-4e3d-b163-2230f8376c71 req-329db5ff-8b68-4897-ad1e-06d6dca7e879 service nova] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 823.058805] env[65446]: INFO networking_nsxv3.common.synchronization [req-a7a79343-4d95-4e3d-b163-2230f8376c71 req-329db5ff-8b68-4897-ad1e-06d6dca7e879 service nova] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 823.058805] env[65446]: INFO networking_nsxv3.common.synchronization [req-a7a79343-4d95-4e3d-b163-2230f8376c71 req-329db5ff-8b68-4897-ad1e-06d6dca7e879 service nova] Enqueued Resource ID: 47f71d4a-ae47-4610-a793-414949829704 with Priority: HIGHEST for action port [ 823.059175] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 823.059294] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 823.059518] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f71d4a-ae47-4610-a793-414949829704 with Priority: HIGHEST for action port [ 823.059858] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.059858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.059858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.060174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.060314] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.061816] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.061949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.062050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.062258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.062392] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.062522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.062583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.062728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.062846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.062980] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.063742] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f71d4a-ae47-4610-a793-414949829704 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.063932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.063932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.064122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.064907] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f71d4a-ae47-4610-a793-414949829704',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.151314] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 823.151596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.151784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.152049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.152176] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.152299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.152364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.152518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.152600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.152683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.152778] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.467814] env[65446]: INFO networking_nsxv3.common.synchronization [req-78dbef72-b20c-470b-86d5-2aa79e056f93 req-db9002c1-9c65-4661-9061-3e18544f45e4 tempest-VolumesAdminNegativeTest-956900489 tempest-VolumesAdminNegativeTest-956900489-project-member] Enqueued Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_members [ 823.468736] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGHEST for action security_group_members [ 823.468814] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.468890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.468981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.469385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.469912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.469912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.469912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.469912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.469912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.470220] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.566607] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.567737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.567871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.568905] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47f71d4a-ae47-4610-a793-414949829704 with status ACTIVE [ 823.568905] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.568905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.568905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.568905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.568905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.568905] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.568905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.568905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.569389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.569389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.569389] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.569389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.569570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.569570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.569650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.569937] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47f71d4a-ae47-4610-a793-414949829704 is going to be updated. [ 823.597751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.598258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.599039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.600030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.600030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.600187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.654904] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.655101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.655177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.655395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.655598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.655709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.655783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.655914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.655992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.656113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.656323] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.656417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.656469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.656610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.656767] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.656859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.656924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.657102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.657177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.657258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.657378] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.885735] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 823.886038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.886278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.886507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.886705] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.886841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.886908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.887077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.887178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.887297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.887396] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.972635] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.973614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.973764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.974045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.974230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.974536] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.974720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.974823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.975341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.975341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.975341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626b100f-ccfe-47af-8e3f-3368124692b1 is going to be updated. [ 824.011728] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.011940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.012918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.012918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.012918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.025014] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626b100f-ccfe-47af-8e3f-3368124692b1 in Status: IN_PROGRESS for 2s [ 824.071583] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.161410] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e72bae3-70cb-43fb-a5f0-90cde0349d10: rpc.has_security_group_logging(os_id): False [ 824.185018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.185018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.185018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.185018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.185725] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.185725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.185725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.185837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.185893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.185983] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 824.256859] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.257065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.257122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.257334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.257605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.284945] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 824.390634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.395028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.395028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.395028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.395028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.396098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.396098] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.574337] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.574526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.574599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.574874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.575046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.575181] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be created. [ 824.602593] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.602836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.602836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.602983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.603175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.614112] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: UNINITIALIZED for 2s [ 824.894355] env[65446]: INFO networking_nsxv3.common.synchronization [req-52d3c035-a011-48a1-9d5d-67610370e666 req-5386591a-6626-41ed-9f17-829aba0a3b72 tempest-ServerTagsTestJSON-65928461 tempest-ServerTagsTestJSON-65928461-project-member] Enqueued Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_members [ 824.895477] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGHEST for action security_group_members [ 824.895477] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.895602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.895680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.895985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.896567] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.896567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.896567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.896567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.896889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.896889] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.899574] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55137d38-b725-49e7-b742-3c0e3a6a4801: rpc.has_security_group_logging(os_id): False [ 824.918271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.918481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.918583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.918812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.918921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.919180] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.919288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.919355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.919515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.919595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.919795] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.919906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.919976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.920141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.920208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.920569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.920569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.920758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.920799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.920865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.920951] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be created. [ 824.986944] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.989020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.989020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.989020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.989020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.003209] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: IN_PROGRESS for 2s [ 825.403044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.403368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.403368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.403494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.403558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.403745] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.403839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.403896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.404078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.404157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.404274] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71f7450b-5fa7-41f3-864b-864413a78a38 is going to be updated. [ 825.459276] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.459439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.459526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.459742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.459887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.477417] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71f7450b-5fa7-41f3-864b-864413a78a38 in Status: IN_PROGRESS for 2s [ 826.034538] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626b100f-ccfe-47af-8e3f-3368124692b1 in Status: SUCCESS [ 826.034538] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626b100f-ccfe-47af-8e3f-3368124692b1 deletion is rescheduled due to dependency. [ 826.034826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.307341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 826.307900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.511782] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.511782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.512720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.512720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.512720] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.626482] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.629171] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.629171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.629171] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.015093] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.017243] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 827.017407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.133346] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.490183] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71f7450b-5fa7-41f3-864b-864413a78a38 in Status: SUCCESS [ 827.490363] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71f7450b-5fa7-41f3-864b-864413a78a38 deletion is rescheduled due to dependency. [ 827.490363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.520324] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.634743] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 103a67fb-9e13-4b72-af0a-1870746747b1: rpc.has_security_group_logging(os_id): False [ 827.652633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.652833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.652875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.653355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.653355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.653504] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.653563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.653601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.653745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.653819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.653943] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be created. [ 827.713491] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.713654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.713701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.713895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.714093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.726690] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 828.021155] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 828.021696] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 828.716106] env[65446]: INFO networking_nsxv3.common.synchronization [req-9846dc57-8420-4beb-a927-20d65fbc8fdb req-490f554b-d05c-49fb-b6d1-23fe6bf4d025 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 828.717375] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 828.719289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.719289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.719289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.720537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.720537] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.722553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.722553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.722553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.722553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.722553] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.104536] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.104536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.104536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.104834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.118046] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 829.118999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.119853] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 829.131885] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.132067] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.132253] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.133042] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.133157] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.133256] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.133328] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.133571] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.133739] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.134018] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.134171] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.134312] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.134423] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.134544] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.134644] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.134770] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.148497] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.148732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.148732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.148909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.154649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.155316] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 829.155399] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 829.155481] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 829.157625] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.157780] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.157912] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.158098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.158414] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.158595] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.158717] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.159030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.159163] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a830560-5cb5-4a79-b23c-41f3bfe6eb53',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.204877] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.205127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.205127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.205369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.207295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.207501] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 829.229078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.229078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.229078] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 already deleted. [ 829.229078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.269026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.269026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.269026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.269026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.269026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.269026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 829.295245] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7ea5ab1a-6536-45ff-a6bb-6276abfef98b None None] Enqueued Resource ID: 9f6aa74b-fefb-47f2-83c4-d1231144aceb with Priority: HIGHEST for action port [ 829.295245] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f6aa74b-fefb-47f2-83c4-d1231144aceb with Priority: HIGHEST for action port [ 829.295245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f6aa74b-fefb-47f2-83c4-d1231144aceb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.295245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f6aa74b-fefb-47f2-83c4-d1231144aceb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.295825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f6aa74b-fefb-47f2-83c4-d1231144aceb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.296458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f6aa74b-fefb-47f2-83c4-d1231144aceb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.296660] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6aa74b-fefb-47f2-83c4-d1231144aceb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.327741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.328159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.330816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.330816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.330816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.330816] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 829.330816] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24', '4638bd1f-1a25-47b3-8d6b-16a31f179b47', '391166e5-be4d-4671-828e-1d856e081893', '3905b26b-bddd-4c0d-8d21-44f2dd75c139', '626b100f-ccfe-47af-8e3f-3368124692b1', 'a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716', '6b40223d-d70d-4f9e-8923-817eac1b52f3', '103a67fb-9e13-4b72-af0a-1870746747b1', 'fba5fede-4e1d-4734-bb87-51495f4aff23', '15a0887e-2263-4406-985f-71a50777bccb', 'ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6', '857e4e4f-84a2-43c7-870d-f3776015cb13', 'ab80b7a2-bff1-489c-be23-2853e30fe3b2', 'dac699f2-0301-418f-ba2d-7f4d7e342f4c', '71f7450b-5fa7-41f3-864b-864413a78a38', '18e18b6c-e111-41c0-8a96-bef49fe17675', 'a8ff462b-9472-43fc-a79a-f055dbe02c56', '7c796209-aa21-4233-aadb-c262182336b7', '55137d38-b725-49e7-b742-3c0e3a6a4801', 'e1f4fde9-b384-4390-8aee-ba47e4cd1304', '6ae2085b-a069-4f37-b210-ebb8cf045349', '38fd7db5-286a-40dc-8ccd-267d22d38c03', 'df9add5c-c992-43ca-9245-5304b7194290', '7dd34d6e-ba50-47dc-9428-10a867ec77b5', '743ab854-8016-4dd1-b444-e671e7099027', '98940883-9fda-4b23-9149-fb7213985597', 'b0365110-9ded-49bd-a10e-2a106e2db350', '4bcaa519-eaf6-4bf5-a9ec-8f1e80048184', '56ef744e-edae-484b-8821-4f332fd192db', 'ea407653-fe6d-49fc-ae9f-5964f5403512', 'e23716b6-1df0-449b-b54b-5cbfb06165bd', '3e72bae3-70cb-43fb-a5f0-90cde0349d10', '79c30290-ba80-4936-8673-39beeb72a136', '73f89999-ebe2-4491-b7a9-a88502cfe139'} {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 829.330816] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 829.350826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.350826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.350826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.350826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.350826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.350826] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 829.350826] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 829.350826] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 829.407119] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.407471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.407471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.407586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.408488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.408594] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 829.408650] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 829.408755] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 829.408844] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 829.408950] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 829.408950] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGH for action security_group_rules [ 829.409060] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGH for action security_group_rules [ 829.409102] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGH for action security_group_rules [ 829.409246] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGH for action security_group_rules [ 829.409246] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGH for action security_group_rules [ 829.409376] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGH for action security_group_rules [ 829.409376] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGH for action security_group_rules [ 829.409376] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGH for action security_group_rules [ 829.409520] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGH for action security_group_rules [ 829.409520] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGH for action security_group_rules [ 829.409615] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGH for action security_group_rules [ 829.409615] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGH for action security_group_rules [ 829.409729] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGH for action security_group_rules [ 829.409729] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGH for action security_group_rules [ 829.409823] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGH for action security_group_rules [ 829.409823] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGH for action security_group_rules [ 829.409920] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGH for action security_group_rules [ 829.409971] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGH for action security_group_rules [ 829.410030] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGH for action security_group_rules [ 829.410073] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGH for action security_group_rules [ 829.411052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.661737] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.662396] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.662707] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.663022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.663197] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.663404] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 8a830560-5cb5-4a79-b23c-41f3bfe6eb53 not found, creating... [ 829.663761] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.663943] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.664102] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.664411] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.664616] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.664946] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.665156] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.665306] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.665548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.665721] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.665891] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 8a830560-5cb5-4a79-b23c-41f3bfe6eb53 is going to be created. [ 829.689269] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.692100] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.692100] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.692100] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.692100] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.692100] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.743028] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 829.743324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.799622] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f6aa74b-fefb-47f2-83c4-d1231144aceb [ 829.800634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.800634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.800634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.800634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.800634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.800634] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f6aa74b-fefb-47f2-83c4-d1231144aceb already deleted. [ 829.800634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f6aa74b-fefb-47f2-83c4-d1231144aceb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.426597] env[65446]: INFO networking_nsxv3.common.synchronization [req-9846dc57-8420-4beb-a927-20d65fbc8fdb req-c3e4f442-20b6-4d72-bf13-24337fe17c84 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 830.426715] env[65446]: INFO networking_nsxv3.common.synchronization [req-9846dc57-8420-4beb-a927-20d65fbc8fdb req-c3e4f442-20b6-4d72-bf13-24337fe17c84 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 830.426849] env[65446]: INFO networking_nsxv3.common.synchronization [req-9846dc57-8420-4beb-a927-20d65fbc8fdb req-c3e4f442-20b6-4d72-bf13-24337fe17c84 service nova] Enqueued Resource ID: 8a830560-5cb5-4a79-b23c-41f3bfe6eb53 with Priority: HIGHEST for action port [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a830560-5cb5-4a79-b23c-41f3bfe6eb53 with Priority: HIGHEST for action port [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGH for action security_group_rules [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 391166e5-be4d-4671-828e-1d856e081893 with Priority: HIGH for action security_group_rules [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGH for action security_group_rules [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f7450b-5fa7-41f3-864b-864413a78a38 with Priority: HIGH for action security_group_rules [ 830.428226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 with Priority: HIGH for action security_group_rules [ 830.428781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGH for action security_group_rules [ 830.428781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c796209-aa21-4233-aadb-c262182336b7 with Priority: HIGH for action security_group_rules [ 830.428781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 with Priority: HIGH for action security_group_rules [ 830.428781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c with Priority: HIGH for action security_group_rules [ 830.428781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 with Priority: HIGH for action security_group_rules [ 830.428781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 with Priority: HIGH for action security_group_rules [ 830.428781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGH for action security_group_rules [ 830.429055] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 with Priority: HIGH for action security_group_rules [ 830.429055] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a0887e-2263-4406-985f-71a50777bccb with Priority: HIGH for action security_group_rules [ 830.429055] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba5fede-4e1d-4734-bb87-51495f4aff23 with Priority: HIGH for action security_group_rules [ 830.429167] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 with Priority: HIGH for action security_group_rules [ 830.429219] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGH for action security_group_rules [ 830.429819] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626b100f-ccfe-47af-8e3f-3368124692b1 with Priority: HIGH for action security_group_rules [ 830.429955] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 with Priority: HIGH for action security_group_rules [ 830.432617] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGH for action security_group_rules [ 830.432617] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.432617] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.432617] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.432617] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.432617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.433988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.433988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.433988] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.433988] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.433988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.433988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.434281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.434281] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a830560-5cb5-4a79-b23c-41f3bfe6eb53',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.437080] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.437080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.437080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.437080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.437080] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.437080] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-391166e5-be4d-4671-828e-1d856e081893 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.437080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.437080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.437080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.437080] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('391166e5-be4d-4671-828e-1d856e081893',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.438063] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.438171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.438254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.438414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.438493] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.440474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71f7450b-5fa7-41f3-864b-864413a78a38 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.440474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.440474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.440474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.440721] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71f7450b-5fa7-41f3-864b-864413a78a38',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.441569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.441792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.441882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.442099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.442194] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f4fde9-b384-4390-8aee-ba47e4cd1304',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.443187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.443315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.443400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.443633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.443796] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.444644] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c796209-aa21-4233-aadb-c262182336b7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.444749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.444813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.444961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.445058] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c796209-aa21-4233-aadb-c262182336b7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.445924] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8ff462b-9472-43fc-a79a-f055dbe02c56 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.446376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.446465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.446601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.446676] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8ff462b-9472-43fc-a79a-f055dbe02c56',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.447094] env[65446]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 830.447815] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.447928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.447992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.448154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.448228] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dac699f2-0301-418f-ba2d-7f4d7e342f4c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.449146] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18e18b6c-e111-41c0-8a96-bef49fe17675 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.449277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.449334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.449491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.449677] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18e18b6c-e111-41c0-8a96-bef49fe17675',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.450904] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.451047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.451122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.452039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.452039] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab80b7a2-bff1-489c-be23-2853e30fe3b2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.453036] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.453036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.453036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.453036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.453286] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.454122] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.454269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.454348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.454509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.454910] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.455718] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15a0887e-2263-4406-985f-71a50777bccb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.456569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.456569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.456569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.456569] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15a0887e-2263-4406-985f-71a50777bccb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.458839] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fba5fede-4e1d-4734-bb87-51495f4aff23 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.458977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.459049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.459187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.459342] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fba5fede-4e1d-4734-bb87-51495f4aff23',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.460416] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.460416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.460530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.460657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.461136] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.461952] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.461952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.461952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.461952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.462285] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.463473] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-626b100f-ccfe-47af-8e3f-3368124692b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.463473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.463473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.463473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.463712] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('626b100f-ccfe-47af-8e3f-3368124692b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.463760] env[65446]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 830.624328] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.624714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.624910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.625382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.625609] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4638bd1f-1a25-47b3-8d6b-16a31f179b47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.628142] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.628468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.628612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.629063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.629305] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.637445] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.642407] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a830560-5cb5-4a79-b23c-41f3bfe6eb53 with status ACTIVE [ 830.642746] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.642918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.643044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.643357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.643494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.643775] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.643983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.644081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.644339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.644464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.644753] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.644904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.644977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.645222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.645347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.645478] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a830560-5cb5-4a79-b23c-41f3bfe6eb53 is going to be updated. [ 830.654451] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.686022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.686227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.686227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.687583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.687583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.687583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a830560-5cb5-4a79-b23c-41f3bfe6eb53" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.802906] env[65446]: INFO networking_nsxv3.common.synchronization [None req-1124b4cc-11ce-4364-9ae7-d17d5967404b tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_rules [ 830.803736] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_rules [ 830.804212] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c822184-f94c-47e7-a37a-4a1a1df93e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.804212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.804212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.806111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.806111] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.911766] env[65446]: INFO networking_nsxv3.common.synchronization [None req-0b852ac4-fc28-4a2e-881a-9667ca3cb2e8 tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_rules [ 830.913038] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_rules [ 830.913038] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c822184-f94c-47e7-a37a-4a1a1df93e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.913038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.135175] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.135685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.162612] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.162612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.162612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.162612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.162612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.162612] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be created. [ 831.189076] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.189229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.189303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.189660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.189660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.191740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.191740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.191740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.192860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.193551] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.193551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.193705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.195658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.195658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.195658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.195658] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.197376] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.197506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.197646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.197720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.197855] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.197950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.198012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.198983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.200119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.200260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.200342] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.212535] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.212811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.212811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.212957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.213252] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.213252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.213252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.215135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.215135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.215135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.215135] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.219605] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.219605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.219605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.219605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.219605] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.219605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.219605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.220015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.220015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.220083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.220195] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.233661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.234659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.234659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.234659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.234659] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.234659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.236208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.236208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.236208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.236208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.236208] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.238236] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.238236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.238236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.238414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.238537] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.238678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.238947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.238947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.239060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.239200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.239371] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.275429] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: UNINITIALIZED for 2s [ 831.301233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.301233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.301233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.301233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.306468] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.306468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.307177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.307177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.308292] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.308431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.309435] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.309593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.315196] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.315321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.316393] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.316502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.317312] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.317414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.321435] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.321574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.322404] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.322503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.323225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.323316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.323983] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 831.324521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.324637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.325701] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 831.326133] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.326293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.336120] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 831.336781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.337178] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fba5fede-4e1d-4734-bb87-51495f4aff23 is going to be deleted. [ 831.337941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.338178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.340501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.340501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.351327] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.351452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.364095] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 831.366178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.366178] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71f7450b-5fa7-41f3-864b-864413a78a38 is going to be deleted. [ 831.366178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.366178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.392123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.392123] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4638bd1f-1a25-47b3-8d6b-16a31f179b47 is going to be deleted. [ 831.392738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.393064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.412774] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.412976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.421744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.421944] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716 is going to be deleted. [ 831.423007] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.423234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.447240] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.447386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.456585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.457354] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f4fde9-b384-4390-8aee-ba47e4cd1304 is going to be deleted. [ 831.457795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.458073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.489456] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.489618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.507530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.507660] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8ff462b-9472-43fc-a79a-f055dbe02c56 is going to be deleted. [ 831.508727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.509042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.569104] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.569349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.571174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.571306] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 626b100f-ccfe-47af-8e3f-3368124692b1 is going to be deleted. [ 831.573176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.573347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.576905] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.577454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.602651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.602768] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab80b7a2-bff1-489c-be23-2853e30fe3b2 is going to be deleted. [ 831.603721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.604035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.670023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.670235] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6 is going to be deleted. [ 831.671518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.671751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.694662] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d00ad1ac-80d4-4cc1-b038-634848d6ef07 None None] Enqueued Resource ID: 567cdfeb-0030-459d-a701-2f0f7ab48248 with Priority: HIGHEST for action port [ 831.694662] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 567cdfeb-0030-459d-a701-2f0f7ab48248 with Priority: HIGHEST for action port [ 831.695152] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-567cdfeb-0030-459d-a701-2f0f7ab48248 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.695931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-567cdfeb-0030-459d-a701-2f0f7ab48248" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.697063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-567cdfeb-0030-459d-a701-2f0f7ab48248" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.697063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-567cdfeb-0030-459d-a701-2f0f7ab48248" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.697063] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('567cdfeb-0030-459d-a701-2f0f7ab48248',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.722243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.722719] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 391166e5-be4d-4671-828e-1d856e081893 is going to be deleted. [ 831.723450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.723676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.724707] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.724971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.724971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.725474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.725474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.725474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.725474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.725706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.725786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.725882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.726055] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.726152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.726223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.726376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.726521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.726609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.726687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.726827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.726942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.727629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.727743] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.730464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.730464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.730692] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.730774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.731993] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.731993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.733451] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.733451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.733451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.733451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.733451] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.733451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.733451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.733451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.733949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.734322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.734322] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.734322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.734322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.734521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.734626] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.734734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.734771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.735025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.735025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.735118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.735160] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.736117] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.740506] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.743199] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857e4e4f-84a2-43c7-870d-f3776015cb13: rpc.has_security_group_logging(os_id): False [ 831.747147] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.747290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.747364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.747606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.747773] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.747872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.747936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.748096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.748183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.748270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.748411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.748506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.748565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.748702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.748839] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.748929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.748989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.749136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.749268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.749325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.749415] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.751582] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.751582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.751582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.751582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.751582] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.751846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.751846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.751919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.751954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.752053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.752201] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.752390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.752478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.752621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.752779] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.753651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.753651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.753651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.753651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.753651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.753651] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.775674] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.775884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.784293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.784676] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dac699f2-0301-418f-ba2d-7f4d7e342f4c is going to be deleted. [ 831.785422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.785845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.820121] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.820121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.822406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.822609] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c796209-aa21-4233-aadb-c262182336b7 is going to be deleted. [ 831.823492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.823715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.883281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.883281] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18e18b6c-e111-41c0-8a96-bef49fe17675 is going to be deleted. [ 831.889182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.889182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.889182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.889182] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 already deleted. [ 831.889182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.889182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.889182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.889959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.890134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.890222] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.931787] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.931996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.950697] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.950856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.963479] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.963754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.968586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.968762] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a0887e-2263-4406-985f-71a50777bccb is going to be deleted. [ 831.969820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.973346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.973501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.973777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fba5fede-4e1d-4734-bb87-51495f4aff23" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.974494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.975458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.975458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.975458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71f7450b-5fa7-41f3-864b-864413a78a38" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.975665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.975802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.975882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.975971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4638bd1f-1a25-47b3-8d6b-16a31f179b47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.976866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.976866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.976866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.976866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1aea9cc-bdc4-4b08-9e8e-fec6eaa88716" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.976866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.976866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.977183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.977183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f4fde9-b384-4390-8aee-ba47e4cd1304" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.977183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.977324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.977381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.977509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-626b100f-ccfe-47af-8e3f-3368124692b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.977639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.977772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.977841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.977949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab80b7a2-bff1-489c-be23-2853e30fe3b2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.978373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.978373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.978373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.978373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8ff462b-9472-43fc-a79a-f055dbe02c56" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.978606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.978779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.051026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.051026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.051026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.051026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.051927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.051927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.051927] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 832.052059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.052208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.052311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.052430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec2f5554-ecf0-4d14-93ef-620fbb6f5cf6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.052565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.052704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.052777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.052883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-391166e5-be4d-4671-828e-1d856e081893" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.053043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.053178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.053249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.053347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dac699f2-0301-418f-ba2d-7f4d7e342f4c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.053470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.053625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.053698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.053803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c796209-aa21-4233-aadb-c262182336b7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.075415] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.080021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.080153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.080394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.080512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.080662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18e18b6c-e111-41c0-8a96-bef49fe17675" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.126444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.126444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.126444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.127498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.127498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.127498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15a0887e-2263-4406-985f-71a50777bccb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.201033] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 567cdfeb-0030-459d-a701-2f0f7ab48248 [ 832.201406] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.201573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.201675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.201926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.202025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.202185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:567cdfeb-0030-459d-a701-2f0f7ab48248 already deleted. [ 832.202267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-567cdfeb-0030-459d-a701-2f0f7ab48248" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.223966] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 832.224713] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.224859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.224928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.225155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.225298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.239209] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3905b26b-bddd-4c0d-8d21-44f2dd75c139: rpc.has_security_group_logging(os_id): False [ 832.243067] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 103a67fb-9e13-4b72-af0a-1870746747b1: rpc.has_security_group_logging(os_id): False [ 832.244287] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55137d38-b725-49e7-b742-3c0e3a6a4801: rpc.has_security_group_logging(os_id): False [ 832.255168] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24: rpc.has_security_group_logging(os_id): False [ 832.256606] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b40223d-d70d-4f9e-8923-817eac1b52f3: rpc.has_security_group_logging(os_id): False [ 832.291239] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.291239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.291239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.291488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.294221] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 832.295027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.295027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.296023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.296023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.296986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.297109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.297768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.297871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.322932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.323484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.323650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.323650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.324591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.324591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.324591] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.324591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.324591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.324980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.325379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.325509] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.325609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.325659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.325830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.325925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.326653] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be updated. [ 832.327239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.328048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.393276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.393438] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.393599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.393648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.393892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.394026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.394179] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.394322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.394421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.394613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.394686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.394877] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.394952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.395026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.395168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.395243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.395337] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be updated. [ 832.396582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.396803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.417734] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.428260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.428260] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.428260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.428260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.428631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.428631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.428697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 832.432186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.432186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.442128] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.442128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.467912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.468271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.468415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.468492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.468743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.468879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.469086] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.469211] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.469283] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.469511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.469620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.469740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.469833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.469888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.470213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.472089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.472089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be updated. [ 832.472885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.473314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.473735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.474017] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 already deleted. [ 832.474017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.474108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.474283] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.495329] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.495530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.497915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.498430] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.498997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.499128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.499412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.499659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.499728] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 832.501037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.501543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.501543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.502491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.502667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.502804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.533225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.533595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.533665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.533964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.534229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.546754] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: IN_PROGRESS for 2s [ 832.550324] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: IN_PROGRESS for 2s [ 832.560477] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 832.606608] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.607037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.607376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.609028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.609028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.641917] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.642197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.642307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.642638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.642818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.661590] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 832.686610] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 833.286775] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 833.287092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.287194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.287425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.287645] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.287766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.287830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.287978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.288075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.288280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.288374] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.567030] env[65446]: INFO networking_nsxv3.common.synchronization [req-44bf8f69-8164-48c6-953e-08126b12493e req-b8b3985b-1c60-4487-8738-f654e1065f8a tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 833.568017] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 833.568353] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.571457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.571457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.571457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.571457] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.571457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.571457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.571457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.571457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.571457] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.791946] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.792252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.792252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.792465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.793225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.793225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.793225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.793569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.793569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.793569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.793842] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.793842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.793842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.794577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.794577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.794577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.794577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.794577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.796157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.796157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.796157] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.968996] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.969253] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.969384] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.969668] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.969929] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.970277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.970410] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.970647] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.970799] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.971131] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.971199] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.971268] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.971381] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.971493] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.971649] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.971790] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.993588] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.993837] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 833.993991] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.994218] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.994604] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.994830] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.995031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.995355] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.995500] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65fdadc0-b51f-4d9d-a798-7abd0c9213b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.075173] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.075704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.075704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.075832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.100558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.100892] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.101093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.101193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.101434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.101547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.101692] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 834.139349] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.139563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.139563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.140680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.140680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.149769] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 834.297710] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 834.314616] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 834.314821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.316976] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.317138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.317209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.317430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.317523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.317709] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.317807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.317869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.318043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.318121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.318322] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.318418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.318520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.318637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.318711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.318899] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.318993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.320590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.320798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.320910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.321037] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be created. [ 834.388270] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.388677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.388763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.388970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.389189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.403078] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 834.500784] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.501103] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.501377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.501905] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.502183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.502353] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 65fdadc0-b51f-4d9d-a798-7abd0c9213b3 not found, creating... [ 834.502851] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.503393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.503905] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.504347] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.504621] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.505251] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.505493] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.505733] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.506351] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.506351] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.507440] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 65fdadc0-b51f-4d9d-a798-7abd0c9213b3 is going to be created. [ 834.541632] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.542088] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.542252] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.542663] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.544534] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.545022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.564028] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 834.564028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.566102] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 834.566676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.577500] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 834.578883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.616214] env[65446]: INFO networking_nsxv3.common.synchronization [None req-dd72b639-4054-46a1-bef3-a81979557735 None None] Enqueued Resource ID: 5d561d28-267a-4163-91a6-10f0fb8caa68 with Priority: HIGHEST for action port [ 834.617408] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d561d28-267a-4163-91a6-10f0fb8caa68 with Priority: HIGHEST for action port [ 834.618729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d561d28-267a-4163-91a6-10f0fb8caa68 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.618729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d561d28-267a-4163-91a6-10f0fb8caa68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.618729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d561d28-267a-4163-91a6-10f0fb8caa68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.618729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d561d28-267a-4163-91a6-10f0fb8caa68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.618729] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d561d28-267a-4163-91a6-10f0fb8caa68',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.691874] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 834.691874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.706910] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 834.706910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.121448] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d561d28-267a-4163-91a6-10f0fb8caa68 [ 835.121913] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.122379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.122379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.122630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.122766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.122965] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d561d28-267a-4163-91a6-10f0fb8caa68 already deleted. [ 835.123574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d561d28-267a-4163-91a6-10f0fb8caa68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.342387] env[65446]: INFO networking_nsxv3.common.synchronization [req-44bf8f69-8164-48c6-953e-08126b12493e req-b26b0f1a-e85d-431a-9d9b-6767833e5616 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 835.342737] env[65446]: INFO networking_nsxv3.common.synchronization [req-44bf8f69-8164-48c6-953e-08126b12493e req-b26b0f1a-e85d-431a-9d9b-6767833e5616 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 835.342837] env[65446]: INFO networking_nsxv3.common.synchronization [req-44bf8f69-8164-48c6-953e-08126b12493e req-b26b0f1a-e85d-431a-9d9b-6767833e5616 service nova] Enqueued Resource ID: 65fdadc0-b51f-4d9d-a798-7abd0c9213b3 with Priority: HIGHEST for action port [ 835.343594] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 835.343773] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 835.343916] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65fdadc0-b51f-4d9d-a798-7abd0c9213b3 with Priority: HIGHEST for action port [ 835.344912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.345084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.345195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.345460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.345571] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.346686] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.347498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.348265] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.348864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.348864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.348864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.348864] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65fdadc0-b51f-4d9d-a798-7abd0c9213b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.850349] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.850573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.851924] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65fdadc0-b51f-4d9d-a798-7abd0c9213b3 with status ACTIVE [ 835.852175] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.852300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.852375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.852603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.852987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.852987] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.853169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.853169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.853272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.853345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.853543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.853639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.853710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.853835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.853907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.853991] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65fdadc0-b51f-4d9d-a798-7abd0c9213b3 is going to be updated. [ 835.881344] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.881734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.881734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.882337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.882337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.882495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65fdadc0-b51f-4d9d-a798-7abd0c9213b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.076843] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e3410ad2-8858-4788-a5a1-605b7f4e12fa tempest-ServersV294TestFqdnHostnames-1003052055 tempest-ServersV294TestFqdnHostnames-1003052055-project-member] Enqueued Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_rules [ 836.077118] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_rules [ 836.077446] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.077561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.077625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.077877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.077960] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.163464] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 836.163464] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 836.163464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.164035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.164343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.164503] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.164681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.164681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.164835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.165162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.165162] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.230293] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e37b4aa4-46bf-499c-96f1-f0732692d52c tempest-ServersV294TestFqdnHostnames-1003052055 tempest-ServersV294TestFqdnHostnames-1003052055-project-member] Enqueued Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_rules [ 836.230293] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_rules [ 836.230293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.230293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.414922] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 836.414922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.610391] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.610584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.610631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.610817] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.610905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.611013] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae already deleted. [ 836.611103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.611254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.611399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.611490] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.669418] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.922270] env[65446]: INFO networking_nsxv3.common.synchronization [req-47f4b7f7-ef98-4d99-bc43-c1c9dcffc2fb req-d06b6007-eec7-4bc0-b5e5-71ac1b5da930 tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 836.924162] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 836.925197] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.925429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.925529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.925765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.926010] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.926153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.926218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.926409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.926496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.926596] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.132751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.132911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.132976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.133201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.133292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.133396] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae already deleted. [ 837.133482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.172034] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.283398] env[65446]: INFO networking_nsxv3.common.synchronization [None req-db48950a-18e5-4dc0-96f9-4243b7c197f4 None None] Enqueued Resource ID: 3c4d008d-fdc1-4257-bca6-0918823a3785 with Priority: HIGHEST for action port [ 837.283398] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4d008d-fdc1-4257-bca6-0918823a3785 with Priority: HIGHEST for action port [ 837.284245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c4d008d-fdc1-4257-bca6-0918823a3785 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.284245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c4d008d-fdc1-4257-bca6-0918823a3785" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.284245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c4d008d-fdc1-4257-bca6-0918823a3785" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.284245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c4d008d-fdc1-4257-bca6-0918823a3785" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.284245] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c4d008d-fdc1-4257-bca6-0918823a3785',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.429057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.429882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.429882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.429882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.429882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.429882] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.429882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.430313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.430313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.430452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.430511] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 837.465050] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.465134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.465210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.465387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.465489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.475766] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 837.674687] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.674880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.675187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.675301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.675432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.675570] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 837.709211] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.709211] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.709443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.709443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.712715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.720723] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 837.787599] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c4d008d-fdc1-4257-bca6-0918823a3785 [ 837.787865] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.788097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.788193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.788533] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.788753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.788829] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c4d008d-fdc1-4257-bca6-0918823a3785 already deleted. [ 837.788948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c4d008d-fdc1-4257-bca6-0918823a3785" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.432739] env[65446]: INFO networking_nsxv3.common.synchronization [req-e64e9352-40db-4b78-8890-106d4cbdadae req-f1410db5-633c-4b8d-953a-f7be669e2eb4 tempest-ServerActionsV293TestJSON-141987590 tempest-ServerActionsV293TestJSON-141987590-project-member] Enqueued Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_members [ 838.433320] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_members [ 838.433668] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.433794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.433880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.435474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.435474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.435474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.435984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.435984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.435984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.435984] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.803677] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.803677] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-779" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.803841] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-779" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.804191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-779" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.804507] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.804781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.804939] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.805223] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.805442] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.805691] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.805862] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.806013] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.806156] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.806292] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.806471] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.806833] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.827051] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.827271] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.827431] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.827618] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-779" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.827933] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-76116615-e088-4d9f-8f98-fffe69a30f85 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.828112] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.828271] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.828541] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.828705] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76116615-e088-4d9f-8f98-fffe69a30f85',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.938138] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.938335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.938381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.938570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.938679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.938885] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.938985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.939059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.939205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.939280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.939429] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 already deleted. [ 838.939517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.331577] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.331822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.331980] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.332273] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.332625] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.332625] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 76116615-e088-4d9f-8f98-fffe69a30f85 not found, creating... [ 839.332823] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.333013] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.333143] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.333394] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.333519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.333804] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.333958] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.334085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.334315] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.334450] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.334587] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 76116615-e088-4d9f-8f98-fffe69a30f85 is going to be created. [ 839.360876] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.361151] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.361276] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.361568] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.361815] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.362084] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.490219] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 839.490863] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 deletion is rescheduled due to dependency. [ 839.490863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.733186] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 839.733419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.733594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.733809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.734013] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.734136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.734243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.734390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.734465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.734575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.734707] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.236926] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.237102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.237174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.237464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.238088] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.238267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.238267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.238426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.238515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.238607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.238813] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.238909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.238969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.239129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.239271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.239363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.239423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.239561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.239635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.239715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.239804] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.498456] env[65446]: INFO networking_nsxv3.common.synchronization [req-e64e9352-40db-4b78-8890-106d4cbdadae req-9c60a003-88ac-4b22-9475-2a1882289de3 service nova] Enqueued Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_rules [ 840.498456] env[65446]: INFO networking_nsxv3.common.synchronization [req-e64e9352-40db-4b78-8890-106d4cbdadae req-9c60a003-88ac-4b22-9475-2a1882289de3 service nova] Enqueued Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_members [ 840.498456] env[65446]: INFO networking_nsxv3.common.synchronization [req-e64e9352-40db-4b78-8890-106d4cbdadae req-9c60a003-88ac-4b22-9475-2a1882289de3 service nova] Enqueued Resource ID: 76116615-e088-4d9f-8f98-fffe69a30f85 with Priority: HIGHEST for action port [ 840.498456] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_rules [ 840.498456] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_members [ 840.498456] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76116615-e088-4d9f-8f98-fffe69a30f85 with Priority: HIGHEST for action port [ 840.498456] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.499177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.499177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.501178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.501285] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.502285] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.502411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.502497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.502731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.502918] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.503036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.503096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.503243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.503323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.503416] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.505421] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-76116615-e088-4d9f-8f98-fffe69a30f85 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.505421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.505421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.505421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.505421] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76116615-e088-4d9f-8f98-fffe69a30f85',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.741770] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184: rpc.has_security_group_logging(os_id): False [ 840.760411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.760630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.760630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.760843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.760931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.761157] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.761255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.761320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.761468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.761546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.761741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.761837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.761900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.762098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.762133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.762305] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.762399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.762462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.762598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.762672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.762757] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 840.828527] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.828727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.828834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.829219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.829256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.843672] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 841.007242] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.007597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.007740] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.008619] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76116615-e088-4d9f-8f98-fffe69a30f85 with status ACTIVE [ 841.008831] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.008946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.009029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.009227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.009314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.009488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.009584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.009645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.009802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.009881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.010255] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.010386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.010460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.010614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.010704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.010796] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76116615-e088-4d9f-8f98-fffe69a30f85 is going to be updated. [ 841.034498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.034785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.034957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.035104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.035313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.035560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76116615-e088-4d9f-8f98-fffe69a30f85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.514388] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.018944] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.018944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.018944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.019252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.019370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.019575] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 is going to be created. [ 842.044433] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.044433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.044623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.045120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.045120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.058369] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 in Status: UNINITIALIZED for 2s [ 842.860871] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 842.861193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.070039] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 in Status: SUCCESS [ 844.070039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.070039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.070039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.070728] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.070728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.070728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.070728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.070728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.070728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.070728] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.413667] env[65446]: INFO networking_nsxv3.common.synchronization [req-0d075ab5-2946-4585-94ed-c06b31b54abe req-e522c614-2913-43b1-a2e1-69efc81af19b tempest-ServerGroupTestJSON-1523204373 tempest-ServerGroupTestJSON-1523204373-project-member] Enqueued Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_members [ 844.414981] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_members [ 844.414981] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.415185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.415185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.415416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.415584] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.415721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.415824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.416060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.416151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.416305] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.573079] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.823481] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.823675] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-965" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.823838] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-965" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.824265] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-965" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.824660] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.824834] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.824955] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.825372] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.825587] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.825979] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.826234] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.826417] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.826588] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.826747] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.826895] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.827072] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.848474] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.848659] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.848839] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.849056] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-965" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.849386] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-bb323206-bdfb-4fef-969b-30e715c77604 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.849567] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.849781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.850274] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.850274] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb323206-bdfb-4fef-969b-30e715c77604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.920207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.920207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.920207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.920207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.920694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.920694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.920694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920694] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 already deleted. [ 844.920865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.075671] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 835eaf64-0d37-43cd-8dd2-62f3d793f1b3: rpc.has_security_group_logging(os_id): False [ 845.095121] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.095257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.095324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.095604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.095729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.095998] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.096120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.096194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.096464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.096554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.096646] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 is going to be created. [ 845.163920] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.164102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.164181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.164432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.164951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.177957] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 in Status: IN_PROGRESS for 2s [ 845.356074] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.356439] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.356644] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.357633] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.357909] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.358162] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port bb323206-bdfb-4fef-969b-30e715c77604 not found, creating... [ 845.358583] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.358906] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.359123] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.359473] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.359699] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.361927] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.362217] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.362404] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.362748] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.362960] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.363192] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: bb323206-bdfb-4fef-969b-30e715c77604 is going to be created. [ 845.386490] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.387202] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.387202] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.387838] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.389088] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.389088] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.193779] env[65446]: INFO networking_nsxv3.common.synchronization [req-0d075ab5-2946-4585-94ed-c06b31b54abe req-395cb0f6-907b-40f1-85a9-b1486f12e2b1 service nova] Enqueued Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_rules [ 846.194041] env[65446]: INFO networking_nsxv3.common.synchronization [req-0d075ab5-2946-4585-94ed-c06b31b54abe req-395cb0f6-907b-40f1-85a9-b1486f12e2b1 service nova] Enqueued Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_members [ 846.194131] env[65446]: INFO networking_nsxv3.common.synchronization [req-0d075ab5-2946-4585-94ed-c06b31b54abe req-395cb0f6-907b-40f1-85a9-b1486f12e2b1 service nova] Enqueued Resource ID: bb323206-bdfb-4fef-969b-30e715c77604 with Priority: HIGHEST for action port [ 846.194752] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_rules [ 846.194893] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_members [ 846.195120] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb323206-bdfb-4fef-969b-30e715c77604 with Priority: HIGHEST for action port [ 846.195420] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.195752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.195752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.195889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.196229] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.198784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.198784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.198784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.198784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.198784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.198784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.198784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.198784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.198784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.199264] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.199644] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb323206-bdfb-4fef-969b-30e715c77604 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.199767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.199814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.199948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.200028] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb323206-bdfb-4fef-969b-30e715c77604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.702342] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.702490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.702697] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.703931] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb323206-bdfb-4fef-969b-30e715c77604 with status ACTIVE [ 846.704147] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.704269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.704336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.704571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.704664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.704840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.704975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.705030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.705347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.705472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.706671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.706826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.706926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.707122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.707573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.707712] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb323206-bdfb-4fef-969b-30e715c77604 is going to be updated. [ 846.732635] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.732813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.732813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.733016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.733158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.733476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb323206-bdfb-4fef-969b-30e715c77604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.192543] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 in Status: SUCCESS [ 847.193443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.210171] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.713627] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.713627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.713627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.713627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.713627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.713627] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 is going to be created. [ 847.739874] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.740142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.740256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.740868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.741191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.756198] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 in Status: UNINITIALIZED for 2s [ 848.386339] env[65446]: INFO networking_nsxv3.common.synchronization [req-7776f3bf-b7c8-45db-83c1-7ae3cd1a43e5 req-be3eb6d3-a9e9-40d2-b47e-acdcbd16b379 tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 848.386339] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 848.386339] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.386339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.386825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.386825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.386907] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.387018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.389659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.389659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.389659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.389659] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.777537] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.777765] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.777858] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.778127] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.778398] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.778556] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.778671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.778902] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.779544] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.779737] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.779854] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.780919] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.780919] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.780919] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.780919] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.780919] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.799289] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.799461] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.799602] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.799781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.800114] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-6d609ca3-b8d1-465e-bc97-7a238213ede0 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.800289] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.800409] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.801751] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.801751] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d609ca3-b8d1-465e-bc97-7a238213ede0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.893237] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.893506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.893891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.894038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.919759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.920160] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.920319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.920391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.920651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.920783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.920910] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 848.950139] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.950349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.950422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.950664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.950864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.965092] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 849.303042] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.303212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.303341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.303857] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.304054] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.304231] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 6d609ca3-b8d1-465e-bc97-7a238213ede0 not found, creating... [ 849.304693] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.304824] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.304871] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.305497] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.305497] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.305678] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.305757] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.305880] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.306215] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.306365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.306602] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 6d609ca3-b8d1-465e-bc97-7a238213ede0 is going to be created. [ 849.330559] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.330875] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.331017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.331298] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.331538] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.331907] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768934] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 in Status: SUCCESS [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.768934] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768934] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.086250] env[65446]: INFO networking_nsxv3.common.synchronization [req-7776f3bf-b7c8-45db-83c1-7ae3cd1a43e5 req-68978455-a1bb-438d-a8bb-7cc86029749b service nova] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_rules [ 850.086250] env[65446]: INFO networking_nsxv3.common.synchronization [req-7776f3bf-b7c8-45db-83c1-7ae3cd1a43e5 req-68978455-a1bb-438d-a8bb-7cc86029749b service nova] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 850.086250] env[65446]: INFO networking_nsxv3.common.synchronization [req-7776f3bf-b7c8-45db-83c1-7ae3cd1a43e5 req-68978455-a1bb-438d-a8bb-7cc86029749b service nova] Enqueued Resource ID: 6d609ca3-b8d1-465e-bc97-7a238213ede0 with Priority: HIGHEST for action port [ 850.086599] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_rules [ 850.086750] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 850.086750] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d609ca3-b8d1-465e-bc97-7a238213ede0 with Priority: HIGHEST for action port [ 850.088057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.088057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.088057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.088057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.088057] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.088808] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.088895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.089302] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d609ca3-b8d1-465e-bc97-7a238213ede0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.089302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.089302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.089665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.089665] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d609ca3-b8d1-465e-bc97-7a238213ede0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.271068] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.271296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.271296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.272123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.272123] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.272123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.272123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.272123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.272123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.272527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.272527] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.272527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.272527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.272691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.272729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.272809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.272866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.272996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.273085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.273165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.273255] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.592518] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.592667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.594028] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d609ca3-b8d1-465e-bc97-7a238213ede0 with status ACTIVE [ 850.594028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.594028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.594028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.594028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.594028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.594028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.594028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.594608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.594608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.594608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.594608] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.594608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.594823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.594857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.594936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.595237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d609ca3-b8d1-465e-bc97-7a238213ede0 is going to be updated. [ 850.634372] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.634372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.634372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.634619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.634745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.634916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d609ca3-b8d1-465e-bc97-7a238213ede0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.778477] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 836e04b1-dc9b-4bf9-99b5-eff0da424604: rpc.has_security_group_logging(os_id): False [ 850.812968] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.812968] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.812968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.814615] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.814615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.814615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.814890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.814890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.815199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.815878] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.815878] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.815878] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.815878] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.816140] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 is going to be created. [ 850.914726] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.917325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.917325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.917325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.917599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.941472] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 in Status: IN_PROGRESS for 2s [ 850.986061] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 850.986260] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 deletion is rescheduled due to dependency. [ 850.986260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.986523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.987421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.987421] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.987421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.987421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.987421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.987421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.987421] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.491838] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.996737] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.500756] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.500756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.500756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.500756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.500756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.500756] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 852.542464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.542742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.542742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.542917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.543089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.557178] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 852.954959] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 in Status: SUCCESS [ 852.955288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.403317] env[65446]: INFO networking_nsxv3.common.synchronization [req-7f307891-8118-49fa-8e61-f57ee8f8d8a0 req-d14f0185-3aea-4034-b927-9efb1a1027d1 tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_members [ 853.404210] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_members [ 853.404718] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.404885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.405152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.405509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.405732] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.405879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.405967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.406195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.406323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.406476] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.862027] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.862390] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.862390] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.862630] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.865827] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.866047] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.866499] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.866609] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.866735] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.866968] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.867104] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.867218] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.867328] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.868671] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.868671] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.868671] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.887676] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.887676] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.887874] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.887959] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-54" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.889688] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-469c687b-e9a1-48b1-b798-5ca244a8dc40 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.889688] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.889688] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.889688] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.889688] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('469c687b-e9a1-48b1-b798-5ca244a8dc40',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.908879] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.909116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.909184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.909844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.909844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.909979] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.910136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.910225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.910388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.910472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.910570] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6972103-6289-4c91-918e-1586283726a6 already deleted. [ 853.910675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.394689] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.394921] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.395061] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.395378] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.395562] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.395724] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 469c687b-e9a1-48b1-b798-5ca244a8dc40 not found, creating... [ 854.395970] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.396145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.396262] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.396519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.396676] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.396982] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.397160] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.397278] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.397535] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.397673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.397843] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 469c687b-e9a1-48b1-b798-5ca244a8dc40 is going to be created. [ 854.418957] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.419378] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.419496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.419893] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.420277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.420639] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.567751] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 854.568061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.568278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.568570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.568927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.569173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.569257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.569435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.569625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.569745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.569880] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.072737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.073095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.073223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.073589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.073876] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.074064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.074165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.074481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.074481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.074653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.074800] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.074976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.075102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.075338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.075569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.075736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.075853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.076119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.076265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.076548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.076548] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.140423] env[65446]: INFO networking_nsxv3.common.synchronization [req-7f307891-8118-49fa-8e61-f57ee8f8d8a0 req-32252914-77d7-4a91-91ad-6ed3dd6efda0 service nova] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_rules [ 855.140601] env[65446]: INFO networking_nsxv3.common.synchronization [req-7f307891-8118-49fa-8e61-f57ee8f8d8a0 req-32252914-77d7-4a91-91ad-6ed3dd6efda0 service nova] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_members [ 855.140777] env[65446]: INFO networking_nsxv3.common.synchronization [req-7f307891-8118-49fa-8e61-f57ee8f8d8a0 req-32252914-77d7-4a91-91ad-6ed3dd6efda0 service nova] Enqueued Resource ID: 469c687b-e9a1-48b1-b798-5ca244a8dc40 with Priority: HIGHEST for action port [ 855.141428] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_rules [ 855.141568] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_members [ 855.141733] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469c687b-e9a1-48b1-b798-5ca244a8dc40 with Priority: HIGHEST for action port [ 855.141950] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.142093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.142147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.142410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.142478] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.145188] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.145338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.145382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.145626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.145785] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.145886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.145948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.146251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.146251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.146337] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.147249] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-469c687b-e9a1-48b1-b798-5ca244a8dc40 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.147360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.147476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.147624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.147712] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('469c687b-e9a1-48b1-b798-5ca244a8dc40',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.578926] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea407653-fe6d-49fc-ae9f-5964f5403512: rpc.has_security_group_logging(os_id): False [ 855.596288] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.596552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.596552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.596752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.596840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.597083] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.597185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.597247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.597399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.597487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.597692] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.597788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.597850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.597990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.598081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.598258] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.598351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.598413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.598543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.598617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.598725] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 855.649576] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.650758] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.650867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.651377] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 469c687b-e9a1-48b1-b798-5ca244a8dc40 with status ACTIVE [ 855.651377] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.651377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.651377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.651652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.651733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.651895] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.652024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.652193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.652256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.652347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.652524] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.652614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.652668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.652809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.652881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.652976] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 469c687b-e9a1-48b1-b798-5ca244a8dc40 is going to be updated. [ 855.673621] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.673826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.673826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.674049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.674193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.674362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-469c687b-e9a1-48b1-b798-5ca244a8dc40" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.697582] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.697780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.697902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.698148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.698295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.733434] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 856.155346] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.185059] env[65446]: INFO networking_nsxv3.common.synchronization [req-cfb32fcc-c746-4fb7-beea-5865b5709a03 req-2a7e621a-79e7-4527-b8e0-35c1393a3cc3 tempest-FloatingIPsAssociationTestJSON-2100177048 tempest-FloatingIPsAssociationTestJSON-2100177048-project-member] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 856.185326] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 856.185670] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.185804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.185870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.186095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.186404] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.186404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.186610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.186610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.186681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.186796] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.574996] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.575238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.575372] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.575669] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.575930] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.576113] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.576235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.576509] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.576655] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.576861] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.576973] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.577095] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.577204] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.577334] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.577441] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.577575] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.598150] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.598483] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.598539] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.598708] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-682" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.599161] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-936e2a73-10ec-441d-9390-61cc1d162e99 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.599539] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.599716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.600322] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.600322] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936e2a73-10ec-441d-9390-61cc1d162e99',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.659789] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.660038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.660038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.660314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.660409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.660517] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6972103-6289-4c91-918e-1586283726a6 is going to be created. [ 856.687651] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.687917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.687995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.688305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.688558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.690638] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.702712] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: UNINITIALIZED for 2s [ 857.102742] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.103093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.103093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.103365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.103528] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.103697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 936e2a73-10ec-441d-9390-61cc1d162e99 not found, creating... [ 857.104032] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.104200] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.104322] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.104553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.104689] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.104980] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.105171] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.105306] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.105549] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.105809] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.105853] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 936e2a73-10ec-441d-9390-61cc1d162e99 is going to be created. [ 857.127367] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.127635] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.127760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.128198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.128304] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.128497] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.193469] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.697117] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.697478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.697478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.697813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.697914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.698032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be updated. [ 857.731681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.731865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.732040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.732118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.732260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.746787] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: IN_PROGRESS for 2s [ 857.751888] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 857.751888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.861272] env[65446]: INFO networking_nsxv3.common.synchronization [req-cfb32fcc-c746-4fb7-beea-5865b5709a03 req-2df27395-087b-46b0-bc1c-a0d435570c41 service nova] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_rules [ 857.861272] env[65446]: INFO networking_nsxv3.common.synchronization [req-cfb32fcc-c746-4fb7-beea-5865b5709a03 req-2df27395-087b-46b0-bc1c-a0d435570c41 service nova] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 857.861272] env[65446]: INFO networking_nsxv3.common.synchronization [req-cfb32fcc-c746-4fb7-beea-5865b5709a03 req-2df27395-087b-46b0-bc1c-a0d435570c41 service nova] Enqueued Resource ID: 936e2a73-10ec-441d-9390-61cc1d162e99 with Priority: HIGHEST for action port [ 857.861272] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_rules [ 857.861272] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 857.861272] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936e2a73-10ec-441d-9390-61cc1d162e99 with Priority: HIGHEST for action port [ 857.861272] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.861914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.862136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.863081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.863081] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.863883] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.864149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.864653] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-936e2a73-10ec-441d-9390-61cc1d162e99 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.865929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.865929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.865929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.865929] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936e2a73-10ec-441d-9390-61cc1d162e99',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.909027] env[65446]: INFO networking_nsxv3.common.synchronization [req-c6e17ba4-fbeb-461b-ac02-db4941b8235b req-601d9936-f02c-4394-8978-5d57d4dd6650 tempest-ServerGroupTestJSON-1523204373 tempest-ServerGroupTestJSON-1523204373-project-member] Enqueued Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_members [ 857.909027] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGHEST for action security_group_members [ 857.909027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.909027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.909027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.909027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.909027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.909027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.909027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.909674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.909900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.910331] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.368179] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 936e2a73-10ec-441d-9390-61cc1d162e99 with status ACTIVE [ 858.368345] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.368566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.368566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.369240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.369240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.369240] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.369240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.369240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.369499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.369499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.369613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.369717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.369786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.369928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.369999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.370102] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 936e2a73-10ec-441d-9390-61cc1d162e99 is going to be updated. [ 858.371311] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.371412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.390954] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.391335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.391335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.391539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.391707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.392227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-936e2a73-10ec-441d-9390-61cc1d162e99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.417486] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.417486] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.417486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.417995] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 is going to be updated. [ 858.455095] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.455095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.455375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.455375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.455760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.466298] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 in Status: IN_PROGRESS for 2s [ 858.712750] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: SUCCESS [ 858.713173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.713173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.713408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.713538] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.713657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.713721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.713876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.713961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.714057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.714245] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.216941] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.720112] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6972103-6289-4c91-918e-1586283726a6: rpc.has_security_group_logging(os_id): False [ 859.741781] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.742071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.742177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.742503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.742668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.743118] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.743291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.743402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.743682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.743828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.743988] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6972103-6289-4c91-918e-1586283726a6 is going to be created. [ 859.760295] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: SUCCESS [ 859.760553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.760694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.760983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.761236] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.761336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.761336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.761484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.761569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.761690] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.822956] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.823240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.823304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.823615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.823909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.836209] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: IN_PROGRESS for 2s [ 860.264228] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.477168] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 in Status: SUCCESS [ 860.477360] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 deletion is rescheduled due to dependency. [ 860.478216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.766546] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.101420] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d599dc82-eb4f-4d6e-a91e-c44c491bc621 None None] Enqueued Resource ID: 454f79fc-639e-4f83-9594-0562fff86a5d with Priority: HIGHEST for action port [ 861.101996] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 454f79fc-639e-4f83-9594-0562fff86a5d with Priority: HIGHEST for action port [ 861.102798] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-454f79fc-639e-4f83-9594-0562fff86a5d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.102798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-454f79fc-639e-4f83-9594-0562fff86a5d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.102798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-454f79fc-639e-4f83-9594-0562fff86a5d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.103095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-454f79fc-639e-4f83-9594-0562fff86a5d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.103095] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('454f79fc-639e-4f83-9594-0562fff86a5d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.269577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.269855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.270686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.270686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.270686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.270686] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be updated. [ 861.307045] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.307247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.307247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.307461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.307607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.317949] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: IN_PROGRESS for 2s [ 861.609376] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 454f79fc-639e-4f83-9594-0562fff86a5d [ 861.609640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.609799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.609881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.610210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.610306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.610407] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:454f79fc-639e-4f83-9594-0562fff86a5d already deleted. [ 861.610497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-454f79fc-639e-4f83-9594-0562fff86a5d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.852293] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: SUCCESS [ 861.852579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.328505] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: SUCCESS [ 863.328831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.329959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.329959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.329959] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.329959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.329959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.329959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.329959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.330313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.330313] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.450389] env[65446]: INFO networking_nsxv3.common.synchronization [None req-8490799a-8a14-43a7-8df8-0db059472ae6 None None] Enqueued Resource ID: 23e9874f-e679-4d6d-9bc0-1103e83299e0 with Priority: HIGHEST for action port [ 863.453281] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e9874f-e679-4d6d-9bc0-1103e83299e0 with Priority: HIGHEST for action port [ 863.453885] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-23e9874f-e679-4d6d-9bc0-1103e83299e0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.454046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23e9874f-e679-4d6d-9bc0-1103e83299e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.454118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23e9874f-e679-4d6d-9bc0-1103e83299e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.455082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23e9874f-e679-4d6d-9bc0-1103e83299e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.455205] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23e9874f-e679-4d6d-9bc0-1103e83299e0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.833369] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.833604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.833681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.833894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.834079] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.834186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.834244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.834378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.834472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.834586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.834740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.834836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.834886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.835039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.835177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.835267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.835323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.835457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.835530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.835608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.835696] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.957818] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23e9874f-e679-4d6d-9bc0-1103e83299e0 [ 863.957997] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.958130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.958204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.958402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.958493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.958591] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23e9874f-e679-4d6d-9bc0-1103e83299e0 already deleted. [ 863.958670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23e9874f-e679-4d6d-9bc0-1103e83299e0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.337745] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dd34d6e-ba50-47dc-9428-10a867ec77b5: rpc.has_security_group_logging(os_id): False [ 864.355793] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.355952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.356038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.356246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.380446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.380726] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.380847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.380916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.381138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.381221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.381419] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.381519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.381585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.381726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.381801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.381982] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.382090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.382152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.382323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.382389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.382433] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be updated. [ 864.533248] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.533248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.533248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.533248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.533248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.551549] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: IN_PROGRESS for 2s [ 866.565738] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: SUCCESS [ 866.566086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.454233] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 868.454577] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 871.243161] env[65446]: INFO networking_nsxv3.common.synchronization [req-a798d1c2-fa9b-4c66-a6c9-1b81781bed64 req-7946c04b-5c16-4a9b-afe6-4219a8e3779d tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_members [ 871.243161] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_members [ 871.244081] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.244437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.244661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.245525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.246595] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.246766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.246766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.246962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.247127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.247434] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.669795] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.670014] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.670146] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.670419] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.670672] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.670829] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.670945] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.671340] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.671528] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.671775] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.671918] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.672067] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.672208] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.672350] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.672481] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.672641] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.693892] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.694116] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.694344] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.694600] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.694947] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-015c390c-910f-426c-b600-5ea3edfb9268 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.695184] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.695336] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.695672] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.695839] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('015c390c-910f-426c-b600-5ea3edfb9268',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.750044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.750269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.750269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.750470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.750591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.750811] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.750936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.751052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.751237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.751338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.751443] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 already deleted. [ 871.751544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.198814] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.199129] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.199498] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.199659] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.199855] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.200102] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 015c390c-910f-426c-b600-5ea3edfb9268 not found, creating... [ 872.200486] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.200703] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.200854] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.201145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.201331] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.201680] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.201873] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.202020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.202246] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.202386] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.202530] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 015c390c-910f-426c-b600-5ea3edfb9268 is going to be created. [ 872.233016] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.233822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.233822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.233822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.234278] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.234612] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.946745] env[65446]: INFO networking_nsxv3.common.synchronization [req-a798d1c2-fa9b-4c66-a6c9-1b81781bed64 req-ec14717b-4a77-4d35-b235-e57d93cbdf90 service nova] Enqueued Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_rules [ 872.946745] env[65446]: INFO networking_nsxv3.common.synchronization [req-a798d1c2-fa9b-4c66-a6c9-1b81781bed64 req-ec14717b-4a77-4d35-b235-e57d93cbdf90 service nova] Enqueued Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_members [ 872.946745] env[65446]: INFO networking_nsxv3.common.synchronization [req-a798d1c2-fa9b-4c66-a6c9-1b81781bed64 req-ec14717b-4a77-4d35-b235-e57d93cbdf90 service nova] Enqueued Resource ID: 015c390c-910f-426c-b600-5ea3edfb9268 with Priority: HIGHEST for action port [ 872.947451] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_rules [ 872.947451] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_members [ 872.947451] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015c390c-910f-426c-b600-5ea3edfb9268 with Priority: HIGHEST for action port [ 872.947710] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.947898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.947898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.948409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.948652] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.949932] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.950119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.950189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.950369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.950523] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.950621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.950681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.950823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.950912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.951019] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.952444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-015c390c-910f-426c-b600-5ea3edfb9268 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.952559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.952631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.952790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.952857] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('015c390c-910f-426c-b600-5ea3edfb9268',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.331862] env[65446]: INFO networking_nsxv3.common.synchronization [req-192e3c72-95b4-4afe-bbb5-1879301ab945 req-232a40b6-b71a-4245-bbd8-22b932bf9aad tempest-ServerAddressesNegativeTestJSON-327953088 tempest-ServerAddressesNegativeTestJSON-327953088-project-member] Enqueued Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_members [ 873.332458] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_members [ 873.332794] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.332911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.332973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.335189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.335189] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.335189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.335189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.335189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.335189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.335189] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.451510] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.451510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.453700] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.456884] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 015c390c-910f-426c-b600-5ea3edfb9268 with status ACTIVE [ 873.457036] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.457263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.457307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.457870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.458913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.459064] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.459183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.459244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.459430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.459528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.459792] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.459928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.460037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.460253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.460371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.460483] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 015c390c-910f-426c-b600-5ea3edfb9268 is going to be updated. [ 873.483364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.484101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.484101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.484101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.484101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.484273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-015c390c-910f-426c-b600-5ea3edfb9268" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.729554] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.729554] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-562" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.729554] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-562" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.730507] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-562" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.730507] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.730507] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.730855] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.730855] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.730968] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.731160] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.731276] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.731381] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.731485] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.731592] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.731720] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.731817] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.750957] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.751077] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.754025] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.754025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-562" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.754025] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-aaef2b65-6359-44df-95cf-6cab826673db taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.754025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.754025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.754025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.754025] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaef2b65-6359-44df-95cf-6cab826673db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.837851] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.839081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.839081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.839081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.839081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.839081] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.839514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.839587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.839773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.839851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.839996] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e already deleted. [ 873.840091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.963573] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.255294] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.255564] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.255644] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.255957] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.256125] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.256309] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port aaef2b65-6359-44df-95cf-6cab826673db not found, creating... [ 874.256671] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.256855] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.256973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.257209] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.257347] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.257672] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.257872] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.257967] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.258200] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.258339] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.258478] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: aaef2b65-6359-44df-95cf-6cab826673db is going to be created. [ 874.277328] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.277522] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.277705] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.278057] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.278299] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.278525] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.468563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.468563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.468563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.468563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.468563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.468563] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 is going to be created. [ 874.494236] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.494411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.494512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.494659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.494788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.513576] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3eac718-710e-4e9f-8192-af1a5cf67174 in Status: UNINITIALIZED for 2s [ 875.004892] env[65446]: INFO networking_nsxv3.common.synchronization [req-192e3c72-95b4-4afe-bbb5-1879301ab945 req-6b35e675-b2fb-4ab6-bf9f-1d75a3451201 service nova] Enqueued Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_rules [ 875.005259] env[65446]: INFO networking_nsxv3.common.synchronization [req-192e3c72-95b4-4afe-bbb5-1879301ab945 req-6b35e675-b2fb-4ab6-bf9f-1d75a3451201 service nova] Enqueued Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_members [ 875.005504] env[65446]: INFO networking_nsxv3.common.synchronization [req-192e3c72-95b4-4afe-bbb5-1879301ab945 req-6b35e675-b2fb-4ab6-bf9f-1d75a3451201 service nova] Enqueued Resource ID: aaef2b65-6359-44df-95cf-6cab826673db with Priority: HIGHEST for action port [ 875.006527] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_rules [ 875.006778] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_members [ 875.007054] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaef2b65-6359-44df-95cf-6cab826673db with Priority: HIGHEST for action port [ 875.007453] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.008296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.008296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.008296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.008296] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.009438] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.009633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.010693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.010693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.010693] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.010693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.010693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.011264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.011264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.011264] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.012265] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaef2b65-6359-44df-95cf-6cab826673db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.012458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.012627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.012894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.013055] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaef2b65-6359-44df-95cf-6cab826673db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.516849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.517028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.517246] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.518282] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aaef2b65-6359-44df-95cf-6cab826673db with status ACTIVE [ 875.518502] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.518643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.519184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.519440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.519548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.519789] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.519920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.522525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.522525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.522525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.522525] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.522525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.522525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.522525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.522525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.522525] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aaef2b65-6359-44df-95cf-6cab826673db is going to be updated. [ 875.546987] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.547204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.547314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.547761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.547904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.548095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaef2b65-6359-44df-95cf-6cab826673db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.025416] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.041204] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fb00e37-2c30-4433-9b7b-1ca3d1324484 req-87a5d95c-ba1a-4af5-b233-92df57193e7b tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 876.042166] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 876.042524] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.042705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.042831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.043154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.043359] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.043804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.043804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.043804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.044138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.044138] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.514020] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.514020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.514020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.514020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.514020] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.514020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.514020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.514869] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.515203] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.515569] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.515844] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.516119] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.519320] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.519320] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.519320] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.519320] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.527620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.528138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.528338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.528742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.529043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.529285] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e is going to be created. [ 876.531313] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3eac718-710e-4e9f-8192-af1a5cf67174 in Status: SUCCESS [ 876.531738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.532151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.532600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.533099] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.533389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.537021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.537021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.537021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.537021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.537021] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.537723] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.538072] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.538362] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.540313] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-917" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.540313] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.540313] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.540313] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.540313] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.540313] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f8ccd09-f915-40b3-8fe6-fdfa8d967307',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.546305] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.558565] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.558944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.559193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.559614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.559913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.571010] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e in Status: UNINITIALIZED for 2s [ 877.039819] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.042490] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.043341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.043341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.043341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.043341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.043517] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 4f8ccd09-f915-40b3-8fe6-fdfa8d967307 not found, creating... [ 877.043774] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.043937] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.044063] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.044285] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.044416] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.044686] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.044848] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.044950] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.045186] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.045320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.045459] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 4f8ccd09-f915-40b3-8fe6-fdfa8d967307 is going to be created. [ 877.048317] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.074825] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.075177] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.075177] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.075552] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.075646] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.075858] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.225856] env[65446]: INFO networking_nsxv3.common.synchronization [None req-58354380-ed5c-49fd-b513-b859af0b5bc3 None None] Enqueued Resource ID: 2847515b-5180-4150-9e55-f514b715fd77 with Priority: HIGHEST for action port [ 877.226701] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2847515b-5180-4150-9e55-f514b715fd77 with Priority: HIGHEST for action port [ 877.226832] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2847515b-5180-4150-9e55-f514b715fd77 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.227186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2847515b-5180-4150-9e55-f514b715fd77" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.227186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2847515b-5180-4150-9e55-f514b715fd77" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.227449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2847515b-5180-4150-9e55-f514b715fd77" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.227449] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2847515b-5180-4150-9e55-f514b715fd77',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.543333] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3eac718-710e-4e9f-8192-af1a5cf67174: rpc.has_security_group_logging(os_id): False [ 877.551506] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.551506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.551710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.551828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.551962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.552076] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 877.564913] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.565097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.565176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.565376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.565467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.565741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.566235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.566235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.566235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.566235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.566440] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 is going to be created. [ 877.583834] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.583834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.583834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.583834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.583834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.594282] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 877.637997] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.638503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.638679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.639153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.639419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.654370] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3eac718-710e-4e9f-8192-af1a5cf67174 in Status: IN_PROGRESS for 2s [ 877.731153] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2847515b-5180-4150-9e55-f514b715fd77 [ 877.731435] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.731569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.731635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.731856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.731941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.732047] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2847515b-5180-4150-9e55-f514b715fd77 already deleted. [ 877.732126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2847515b-5180-4150-9e55-f514b715fd77" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.785514] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fb00e37-2c30-4433-9b7b-1ca3d1324484 req-6ba5d1dd-f04a-44d1-a9db-e816647c3e2e service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 877.786173] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fb00e37-2c30-4433-9b7b-1ca3d1324484 req-6ba5d1dd-f04a-44d1-a9db-e816647c3e2e service nova] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 877.786173] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fb00e37-2c30-4433-9b7b-1ca3d1324484 req-6ba5d1dd-f04a-44d1-a9db-e816647c3e2e service nova] Enqueued Resource ID: 4f8ccd09-f915-40b3-8fe6-fdfa8d967307 with Priority: HIGHEST for action port [ 877.786661] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_rules [ 877.786837] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 877.786897] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8ccd09-f915-40b3-8fe6-fdfa8d967307 with Priority: HIGHEST for action port [ 877.787198] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.787528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.787528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.787688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.787688] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.788545] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.788643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.788874] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.788933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.789041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.789165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.789242] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f8ccd09-f915-40b3-8fe6-fdfa8d967307',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.082267] env[65446]: INFO networking_nsxv3.common.synchronization [req-5d16704c-2ee0-4493-b7ab-c94d504b2380 req-88ff1dd8-7c56-41d5-9953-c1bcc59cbb82 tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 878.083226] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 878.083710] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.083884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.083954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.085234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.085234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.085234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.085234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.085234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.085234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.085234] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.294918] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.295159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.295342] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f8ccd09-f915-40b3-8fe6-fdfa8d967307 with status ACTIVE [ 878.295459] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.295577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.295626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.295844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.295937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.296131] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.296229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.296287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.296436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.296514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.296732] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.297081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.297081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.297081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.297224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.297224] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f8ccd09-f915-40b3-8fe6-fdfa8d967307 is going to be updated. [ 878.322840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.322840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.322840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.322840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.323120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.323350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f8ccd09-f915-40b3-8fe6-fdfa8d967307" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.568683] env[65446]: INFO networking_nsxv3.common.synchronization [req-05abd788-e522-483e-913d-c9400777be83 req-ffeb501c-4aaf-40fd-9cff-4517d6cd3d7b tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_members [ 878.569283] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_members [ 878.569595] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c822184-f94c-47e7-a37a-4a1a1df93e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.569802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.569874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.570134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.570293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.571230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.571371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.571645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.571797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.571944] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.582364] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e in Status: SUCCESS [ 878.583079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.583079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.583079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.583276] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.583416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.583511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.583693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.583780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.583867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.584079] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.590215] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.590338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.590406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.590701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.590701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.590818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.590912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.590974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.591387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.591387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.591387] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 878.621043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.621373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.622411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.622411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.622411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.632224] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 878.963460] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.963590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.963725] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.964623] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.965493] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.965938] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.965999] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.966271] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.966432] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.966679] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.966798] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.966909] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.967029] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.967147] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.967294] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.967383] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.991885] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.992089] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.992235] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.992417] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.992892] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-8b875dd6-6d95-4745-92be-1e2d030d218c taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.992973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.993093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.993421] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.993559] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b875dd6-6d95-4745-92be-1e2d030d218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.076145] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.076733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.076948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.077497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.077737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.078096] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.078362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.078668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.078992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.080508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.080508] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 already deleted. [ 879.080508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.087010] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.088339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.088339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.088339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.088339] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.088601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.088601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.088673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.088758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.088993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.089437] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.089599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.089704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.089937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.090138] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.090243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.090307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.090453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.090526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.090634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.090740] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.190039] env[65446]: INFO networking_nsxv3.common.synchronization [None req-a63b6b9e-5249-48ea-85e2-725b00233494 None None] Enqueued Resource ID: 57b6a809-24f4-4c89-90ca-b6e59b62f030 with Priority: HIGHEST for action port [ 879.190319] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b6a809-24f4-4c89-90ca-b6e59b62f030 with Priority: HIGHEST for action port [ 879.190891] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-57b6a809-24f4-4c89-90ca-b6e59b62f030 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.191028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57b6a809-24f4-4c89-90ca-b6e59b62f030" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.191098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57b6a809-24f4-4c89-90ca-b6e59b62f030" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.191344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57b6a809-24f4-4c89-90ca-b6e59b62f030" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.191427] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57b6a809-24f4-4c89-90ca-b6e59b62f030',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.497185] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.497369] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.497828] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.497979] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.498023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.498193] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 8b875dd6-6d95-4745-92be-1e2d030d218c not found, creating... [ 879.498797] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.498797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.498797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.499152] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.499208] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.499492] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.499751] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.499835] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.499996] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.500160] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.500505] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 8b875dd6-6d95-4745-92be-1e2d030d218c is going to be created. [ 879.521625] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.521859] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.522010] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.522325] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.522610] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.522903] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.594346] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c643e66c-7f7f-4e0f-8505-d639c9542f3e: rpc.has_security_group_logging(os_id): False [ 879.613968] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 879.614226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.615273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.615528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.615737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.615873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.615940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.616124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.616210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.616311] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.621924] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.622084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.622126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.622413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.622413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.622777] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.622777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.622777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.622980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.623649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.623649] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.623649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.623649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.623649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.623649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.623843] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.623843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.623939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.625036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.625134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.625245] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e is going to be created. [ 879.672112] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3eac718-710e-4e9f-8192-af1a5cf67174 in Status: SUCCESS [ 879.672360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.693652] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57b6a809-24f4-4c89-90ca-b6e59b62f030 [ 879.694233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.694465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.694603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.694902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.695056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.695871] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57b6a809-24f4-4c89-90ca-b6e59b62f030 already deleted. [ 879.695871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57b6a809-24f4-4c89-90ca-b6e59b62f030" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.722649] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.722801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.722873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.723144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.723337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.735214] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e in Status: IN_PROGRESS for 2s [ 880.127895] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.267704] env[65446]: INFO networking_nsxv3.common.synchronization [req-05abd788-e522-483e-913d-c9400777be83 req-50b158c1-216e-4847-9627-09fb63e39070 service nova] Enqueued Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_rules [ 880.267888] env[65446]: INFO networking_nsxv3.common.synchronization [req-05abd788-e522-483e-913d-c9400777be83 req-50b158c1-216e-4847-9627-09fb63e39070 service nova] Enqueued Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_members [ 880.268038] env[65446]: INFO networking_nsxv3.common.synchronization [req-05abd788-e522-483e-913d-c9400777be83 req-50b158c1-216e-4847-9627-09fb63e39070 service nova] Enqueued Resource ID: 8b875dd6-6d95-4745-92be-1e2d030d218c with Priority: HIGHEST for action port [ 880.268570] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_rules [ 880.268707] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_members [ 880.268810] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b875dd6-6d95-4745-92be-1e2d030d218c with Priority: HIGHEST for action port [ 880.269366] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c822184-f94c-47e7-a37a-4a1a1df93e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.269505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.269574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.269778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.269864] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.271174] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c822184-f94c-47e7-a37a-4a1a1df93e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.271298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.271447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.271644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.272460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.272460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.272460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.272460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.272460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.272460] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.274196] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b875dd6-6d95-4745-92be-1e2d030d218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.274645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.274645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.274645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.274645] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b875dd6-6d95-4745-92be-1e2d030d218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.631505] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.654111] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 880.654780] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 deletion is rescheduled due to dependency. [ 880.654780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.774431] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.777703] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b875dd6-6d95-4745-92be-1e2d030d218c with status ACTIVE [ 880.777703] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.777703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.777703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.777703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.777703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.777703] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.777703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.777703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.777703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.780076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.782805] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.782805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.782805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.782805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.782805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.782805] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b875dd6-6d95-4745-92be-1e2d030d218c is going to be updated. [ 880.782805] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c822184-f94c-47e7-a37a-4a1a1df93e39 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.782805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.806288] env[65446]: INFO networking_nsxv3.common.synchronization [req-1825be65-e797-4f5f-8d4e-9404874008bf req-ffa41eaf-cf1d-4483-89f4-703e52371fa6 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 880.806288] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 880.810129] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.811032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.811032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.811032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.811032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.811248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.812067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.812067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.812067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.812067] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.814276] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.815167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.815167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.815167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.815167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.815466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b875dd6-6d95-4745-92be-1e2d030d218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.840107] env[65446]: INFO networking_nsxv3.common.synchronization [req-1825be65-e797-4f5f-8d4e-9404874008bf req-ffa41eaf-cf1d-4483-89f4-703e52371fa6 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 880.841132] env[65446]: INFO networking_nsxv3.common.synchronization [req-1825be65-e797-4f5f-8d4e-9404874008bf req-ffa41eaf-cf1d-4483-89f4-703e52371fa6 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 880.841132] env[65446]: INFO networking_nsxv3.common.synchronization [req-1825be65-e797-4f5f-8d4e-9404874008bf req-ffa41eaf-cf1d-4483-89f4-703e52371fa6 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 47f71d4a-ae47-4610-a793-414949829704 with Priority: HIGHEST for action port [ 880.841590] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 880.843163] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 880.843163] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f71d4a-ae47-4610-a793-414949829704 with Priority: HIGHEST for action port [ 880.843163] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.843163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.843163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.843163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.843163] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.846219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.846219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.846219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f71d4a-ae47-4610-a793-414949829704 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.846219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.846219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.846219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.846219] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f71d4a-ae47-4610-a793-414949829704',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.130085] env[65446]: INFO networking_nsxv3.common.synchronization [req-9a76e4fd-9784-4834-9b7d-9e58a7bc0b6b req-48d188f3-29ec-47ce-9d26-719e74d9b0fe tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 881.130791] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 881.131738] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.131738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.131738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.131738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.131925] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.131997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.132104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.132315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.132896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.132896] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.137039] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.137039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.137039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.137199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.137277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.137426] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 881.168650] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.168650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.168650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.168910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.168910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.178786] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 881.276722] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.317675] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.346151] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.346298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.346531] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47f71d4a-ae47-4610-a793-414949829704 with status ACTIVE [ 881.346756] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.346875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.346953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.347853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.347853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.347853] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.347853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.347853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.348098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.348098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.348184] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.348448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.348448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.348448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.348637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.348637] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47f71d4a-ae47-4610-a793-414949829704 is going to be updated. [ 881.376569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.376722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.376722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.376951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.377146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.377311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.608726] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.608910] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.608910] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.609597] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.609894] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.610068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.610197] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.610489] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.610698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.610998] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.611146] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.611260] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.611374] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.611794] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.611794] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.611794] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.631889] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.632206] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.632378] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.632667] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.633163] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-047f385f-6284-4bca-b806-2341bfb17f4f taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.633461] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.633674] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.634243] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.634535] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('047f385f-6284-4bca-b806-2341bfb17f4f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.635833] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.636027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.636165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.636429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.636604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.636907] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.637085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.637198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.637444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.637569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.637698] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 881.665868] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.666054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.666112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.666296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.666437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.676861] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 881.747777] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e in Status: SUCCESS [ 881.747983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.783385] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.783633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.783734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.784055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.784477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.784477] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 is going to be created. [ 881.821065] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.821065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.821065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.821065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.821065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.824670] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.832900] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 in Status: UNINITIALIZED for 2s [ 882.141024] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.141469] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.141469] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.141622] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.141801] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.141957] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 047f385f-6284-4bca-b806-2341bfb17f4f not found, creating... [ 882.142336] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.142861] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.142861] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.142976] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.143130] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.144431] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.144634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.144761] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.144996] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.145187] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.145397] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 047f385f-6284-4bca-b806-2341bfb17f4f is going to be created. [ 882.169407] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.169672] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.169844] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.170221] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.170469] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.170703] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.327627] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.327897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.327948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.328197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.328291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.328394] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 882.374325] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.374501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.374656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.374945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.375221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.386071] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 882.883022] env[65446]: INFO networking_nsxv3.common.synchronization [req-9a76e4fd-9784-4834-9b7d-9e58a7bc0b6b req-953709d5-44f4-4381-b733-4edcad08c78c service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 882.883022] env[65446]: INFO networking_nsxv3.common.synchronization [req-9a76e4fd-9784-4834-9b7d-9e58a7bc0b6b req-953709d5-44f4-4381-b733-4edcad08c78c service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 882.883022] env[65446]: INFO networking_nsxv3.common.synchronization [req-9a76e4fd-9784-4834-9b7d-9e58a7bc0b6b req-953709d5-44f4-4381-b733-4edcad08c78c service nova] Enqueued Resource ID: 047f385f-6284-4bca-b806-2341bfb17f4f with Priority: HIGHEST for action port [ 882.883022] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 882.883022] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 882.883022] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047f385f-6284-4bca-b806-2341bfb17f4f with Priority: HIGHEST for action port [ 882.883022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.883022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.883022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.883022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.883022] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.884752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.884863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.885056] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-047f385f-6284-4bca-b806-2341bfb17f4f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.885173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.885225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.885386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.885458] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('047f385f-6284-4bca-b806-2341bfb17f4f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.921807] env[65446]: INFO networking_nsxv3.common.synchronization [req-bc804c82-a5df-4f29-bab6-d1b3ac0e4875 req-23a089fc-8473-4159-b91f-5c96ae7b4f48 tempest-FloatingIPsAssociationTestJSON-2100177048 tempest-FloatingIPsAssociationTestJSON-2100177048-project-member] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 882.921935] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 882.922208] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.922327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.922382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.922577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.922737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.922830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.922891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.923704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.923704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.923704] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.189881] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 883.190282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.190282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.190489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.190677] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.190797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.190886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.191034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.191120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.191203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.191296] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.387017] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.387177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.388624] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 047f385f-6284-4bca-b806-2341bfb17f4f with status ACTIVE [ 883.388829] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.389050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.389141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.389383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.389478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.389691] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.389794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.389870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.390045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.390127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.390339] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.390463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.390499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.390657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.390734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.390821] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 047f385f-6284-4bca-b806-2341bfb17f4f is going to be updated. [ 883.420466] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.420466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.420466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.420776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.420776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.420912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-047f385f-6284-4bca-b806-2341bfb17f4f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.428414] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.688449] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 883.689425] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 deletion is rescheduled due to dependency. [ 883.689636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.689877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.690152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.690381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.690630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.690786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.691065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.691182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.691304] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.693688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.693802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.693871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.694062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.694303] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.694636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.694756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.694958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.695065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.695635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.695635] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.695635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.695635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.695635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.695843] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.695938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.695976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.698931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.699073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.699180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.699298] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.738425] env[65446]: INFO networking_nsxv3.common.synchronization [req-c3771f23-7ceb-479e-bac7-7381f80ae022 req-3f991915-6785-4529-b6e9-d5cf3b2d1d19 tempest-ServersV294TestFqdnHostnames-1003052055 tempest-ServersV294TestFqdnHostnames-1003052055-project-member] Enqueued Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_members [ 883.739240] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_members [ 883.739666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.739833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.739945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.740291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.740472] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.740649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.740649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.740770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.740868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.740939] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.846037] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 in Status: SUCCESS [ 883.846037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.846037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.846037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.846037] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.846430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.846430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.846430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.846502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.846648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.846707] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.934654] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.097274] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.097548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-887" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.097703] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-887" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.098632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-887" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.099083] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.099351] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.099996] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.100138] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.100307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.100574] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.100752] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.100833] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.100907] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.101092] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.101199] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.101357] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.122610] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.122830] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.123037] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.123255] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-887" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.123608] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.123813] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.123978] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.124356] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.124521] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff0cd66-5eda-420d-bea7-0e71e0e0d41b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.200837] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.201905] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e72bae3-70cb-43fb-a5f0-90cde0349d10: rpc.has_security_group_logging(os_id): False [ 884.221460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.221752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.221752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.221989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.245890] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.245890] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.245890] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.245890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.246407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.246407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.246407] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 884.247074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.247185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.247301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.247407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.247487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.247879] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.248042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.248118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.248278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.248356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.248443] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae already deleted. [ 884.248524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.320883] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.321105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.321149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.321442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.321880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.340294] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 884.350398] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.398223] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 884.398478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.398624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.398991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.399241] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.399377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.399463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.399660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.399755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.399858] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.428064] env[65446]: INFO networking_nsxv3.common.synchronization [req-49e30d49-972b-4929-95c3-5485f1cdd808 req-c61c3bac-b56c-4996-bab6-18b42f3b93c5 tempest-MigrationsAdminTest-1736177509 tempest-MigrationsAdminTest-1736177509-project-member] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 884.428926] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 884.429357] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.429497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.429593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.429895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.430132] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.430249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.430344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.430524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.430612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.430729] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.437966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.438160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.438241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.438559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.438722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.438856] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be updated. [ 884.476096] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.476298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.476298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.476496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.476672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.489243] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: IN_PROGRESS for 2s [ 884.627218] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.627506] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.627781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.628194] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.628295] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.628457] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 1ff0cd66-5eda-420d-bea7-0e71e0e0d41b not found, creating... [ 884.628781] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.628961] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.629105] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.629393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.629540] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.630091] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.630091] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.630224] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.630409] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.630536] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.630682] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 1ff0cd66-5eda-420d-bea7-0e71e0e0d41b is going to be created. [ 884.651940] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.652216] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.652346] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.652603] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.652833] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.653134] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.704542] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.853026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c822184-f94c-47e7-a37a-4a1a1df93e39: rpc.has_security_group_logging(os_id): False [ 884.872673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.872863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.872933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.873119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.873209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.873454] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.873554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.873613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.873816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.873879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.873966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 is going to be created. [ 884.902100] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.933323] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.946322] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.946496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.946537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.946851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.947014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.962506] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 in Status: IN_PROGRESS for 2s [ 885.207557] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.208032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.208032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.208360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.208360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.208360] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 885.239077] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.239248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.239326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.239624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.239746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.254855] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 885.386948] env[65446]: INFO networking_nsxv3.common.synchronization [req-c3771f23-7ceb-479e-bac7-7381f80ae022 req-a4606c21-bd1a-4aec-9876-5faccdb1a28e service nova] Enqueued Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_rules [ 885.386948] env[65446]: INFO networking_nsxv3.common.synchronization [req-c3771f23-7ceb-479e-bac7-7381f80ae022 req-a4606c21-bd1a-4aec-9876-5faccdb1a28e service nova] Enqueued Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_members [ 885.386948] env[65446]: INFO networking_nsxv3.common.synchronization [req-c3771f23-7ceb-479e-bac7-7381f80ae022 req-a4606c21-bd1a-4aec-9876-5faccdb1a28e service nova] Enqueued Resource ID: 1ff0cd66-5eda-420d-bea7-0e71e0e0d41b with Priority: HIGHEST for action port [ 885.386948] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_rules [ 885.386948] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_members [ 885.386948] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff0cd66-5eda-420d-bea7-0e71e0e0d41b with Priority: HIGHEST for action port [ 885.386948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.387344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.387408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.387635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.387730] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.388601] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.388743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.388930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.389180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.389335] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.389569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.389569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.389696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.389696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.389806] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.390618] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.391136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.391301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.392668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.392733] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff0cd66-5eda-420d-bea7-0e71e0e0d41b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.404597] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.436912] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.894287] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.897042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.897042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.897561] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ff0cd66-5eda-420d-bea7-0e71e0e0d41b with status ACTIVE [ 885.898217] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.898381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.898514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.898926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.899148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.899364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.899501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.899600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.899787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.899944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.900801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.900911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.900978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.901582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.901643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.902330] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ff0cd66-5eda-420d-bea7-0e71e0e0d41b is going to be updated. [ 885.907948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.908076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.908143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.908320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.908403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.908494] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 885.924145] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.924293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.924362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.924579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.924744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.924922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff0cd66-5eda-420d-bea7-0e71e0e0d41b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.936203] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.936782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.936782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.937016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.937156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.938491] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.938491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.938739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.939432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.939432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.939432] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be updated. [ 885.950947] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 885.989294] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.989431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.989487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.990181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.990335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.000337] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: IN_PROGRESS for 2s [ 886.360854] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 886.360854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.398501] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.488252] env[65446]: INFO networking_nsxv3.common.synchronization [req-f7caf7f5-7a35-4795-902d-dc2dcd28f1f6 req-cfeeceb6-71eb-445b-867e-ee89bd0eed71 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 886.493799] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 886.494676] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.494842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.502592] env[65446]: INFO networking_nsxv3.common.synchronization [req-f7caf7f5-7a35-4795-902d-dc2dcd28f1f6 req-cfeeceb6-71eb-445b-867e-ee89bd0eed71 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 886.502761] env[65446]: INFO networking_nsxv3.common.synchronization [req-f7caf7f5-7a35-4795-902d-dc2dcd28f1f6 req-cfeeceb6-71eb-445b-867e-ee89bd0eed71 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 886.502896] env[65446]: INFO networking_nsxv3.common.synchronization [req-f7caf7f5-7a35-4795-902d-dc2dcd28f1f6 req-cfeeceb6-71eb-445b-867e-ee89bd0eed71 tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 47f71d4a-ae47-4610-a793-414949829704 with Priority: HIGHEST for action port [ 886.503858] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: SUCCESS [ 886.504403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.504886] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_rules [ 886.505057] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 886.505424] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f71d4a-ae47-4610-a793-414949829704 with Priority: HIGHEST for action port [ 886.506228] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.506361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.506663] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.506766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.507431] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f71d4a-ae47-4610-a793-414949829704 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.507805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.507938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.508181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.508335] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f71d4a-ae47-4610-a793-414949829704',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.904966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.904966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.904966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.904966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.904966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.904966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae is going to be created. [ 886.933165] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.934107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.934107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.934107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.934107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.946129] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd996317-fb1b-4d07-a8c8-969fa47508ae in Status: UNINITIALIZED for 2s [ 886.980832] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 in Status: SUCCESS [ 886.980832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.014027] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47f71d4a-ae47-4610-a793-414949829704 with status ACTIVE [ 887.014027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.014027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.014027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.014027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.014027] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47f71d4a-ae47-4610-a793-414949829704 is going to be updated. [ 887.044549] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.044975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.045197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.045541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.045820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.046132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f71d4a-ae47-4610-a793-414949829704" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.231149] env[65446]: INFO networking_nsxv3.common.synchronization [req-c0fae91d-7ced-4071-84b4-19ea01ede6f0 req-c22ff126-8fe8-4b8f-9c50-77fb5e98ca80 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 887.231871] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 887.232217] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.233126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.233238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.233447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.233633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.233749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.233821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.233994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.234116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.234239] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.268306] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 887.268626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.269386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.269534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.269791] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.269948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.270062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.270258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.270343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.270553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.270553] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.625528] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.625923] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.625923] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.626283] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.626827] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.627087] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.627277] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.627670] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.627961] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.628713] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.628936] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.629160] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.629411] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.629569] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.629773] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.630039] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.655349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.655537] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.655684] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.655892] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.656331] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-1ff72a52-73f6-441f-a599-3f95c262e584 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.656542] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.656705] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.657338] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.657569] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff72a52-73f6-441f-a599-3f95c262e584',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.737873] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.775620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.775941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.776052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.776272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.776617] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.776802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.776948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.777176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.777298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.777547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.777818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.777985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.778265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.778353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.778526] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.778672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.778829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.779180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.779180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.779252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.779324] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.962091] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 887.962091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.962091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.962091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.962289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.962342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.963054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.963054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.963054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.963054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.963054] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.963726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.963890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.964116] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.964279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.964351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.964508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.964587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.964713] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.012801] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 888.013087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.160458] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.160689] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.160823] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.161244] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.161280] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.161447] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 1ff72a52-73f6-441f-a599-3f95c262e584 not found, creating... [ 888.161707] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.161864] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.161980] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.162233] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.162373] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.162651] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.162830] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.162955] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.163153] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.163295] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.163433] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 1ff72a52-73f6-441f-a599-3f95c262e584 is going to be created. [ 888.183410] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.183675] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.183804] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.184092] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.184763] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.184763] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.240597] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.281745] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857e4e4f-84a2-43c7-870d-f3776015cb13: rpc.has_security_group_logging(os_id): False [ 888.323492] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.323687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.323767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.324011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.324116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.324319] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.324446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.324571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.324874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.325026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.325377] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.325540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.325643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.325870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.325974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.326204] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.326304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.326366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.326511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.326608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.326740] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 888.427428] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.427428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.427428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.427428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.427428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.447960] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 888.466944] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.468199] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.743245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.743533] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.743533] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.743695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.743786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.743906] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 888.774181] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.774337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.774393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.775027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.775027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.783852] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 888.890390] env[65446]: INFO networking_nsxv3.common.synchronization [req-c0fae91d-7ced-4071-84b4-19ea01ede6f0 req-1842210b-775c-499f-9675-7ec45c4b1d42 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 888.890511] env[65446]: INFO networking_nsxv3.common.synchronization [req-c0fae91d-7ced-4071-84b4-19ea01ede6f0 req-1842210b-775c-499f-9675-7ec45c4b1d42 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 888.890684] env[65446]: INFO networking_nsxv3.common.synchronization [req-c0fae91d-7ced-4071-84b4-19ea01ede6f0 req-1842210b-775c-499f-9675-7ec45c4b1d42 service nova] Enqueued Resource ID: 1ff72a52-73f6-441f-a599-3f95c262e584 with Priority: HIGHEST for action port [ 888.891200] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 888.891341] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 888.891452] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff72a52-73f6-441f-a599-3f95c262e584 with Priority: HIGHEST for action port [ 888.891717] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.891838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.891904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.892136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.892218] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.893109] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.893207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.893401] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff72a52-73f6-441f-a599-3f95c262e584 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.893501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.893564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.893738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.894073] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff72a52-73f6-441f-a599-3f95c262e584',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.962777] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd996317-fb1b-4d07-a8c8-969fa47508ae in Status: SUCCESS [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.962777] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.962777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.962777] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.971589] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 103a67fb-9e13-4b72-af0a-1870746747b1: rpc.has_security_group_logging(os_id): False [ 888.972758] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.991933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.992088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.992176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.992407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.992498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.992743] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.992845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.992909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.993101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.993182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.993271] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 889.069831] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.070045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.070460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.070913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.071738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.090613] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 889.396509] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.396686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.396841] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ff72a52-73f6-441f-a599-3f95c262e584 with status ACTIVE [ 889.397041] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.397147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.397203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.397404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.397493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.397694] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.397773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.397833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.398031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.398078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.398252] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.398341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.398450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.399152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.399287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.399387] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ff72a52-73f6-441f-a599-3f95c262e584 is going to be updated. [ 889.403039] env[65446]: INFO networking_nsxv3.common.synchronization [req-6debbd8d-9fdc-497c-9831-dcf1a31432e3 req-7064ead9-9745-45ce-ae51-5057589f7e44 tempest-ServerAddressesNegativeTestJSON-327953088 tempest-ServerAddressesNegativeTestJSON-327953088-project-member] Enqueued Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_members [ 889.403390] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGHEST for action security_group_members [ 889.403694] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.403821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.403884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.404091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.404261] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.404354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.404429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.404777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.404777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.404864] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.426407] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.426614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.426738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.426993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.427173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.427355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff72a52-73f6-441f-a599-3f95c262e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.466502] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.475165] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.475165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.475165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.475409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.475485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.475587] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 889.524061] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.524154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.524154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.524370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.524522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.536577] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 889.908194] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.908500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.908500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.908618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.908648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.908854] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.908954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.909035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.909186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.909265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.910011] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e is going to be updated. [ 889.944620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.944776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.944822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.946237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.946320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.957627] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e in Status: IN_PROGRESS for 2s [ 889.969128] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd996317-fb1b-4d07-a8c8-969fa47508ae: rpc.has_security_group_logging(os_id): False [ 889.995794] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.995794] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.995794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.995794] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae is going to be created. [ 890.070161] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.070161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.070161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.070161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.070161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.082874] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd996317-fb1b-4d07-a8c8-969fa47508ae in Status: IN_PROGRESS for 2s [ 890.471041] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 890.471412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.797279] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 890.797452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.797620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.797882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.798144] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.798264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.798264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.798421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.798502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.798601] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.110392] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 891.110745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.111262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.111535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.111656] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.301233] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.548623] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 891.550297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.550297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.550297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.550297] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.550297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.550297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.550297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.550297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.550297] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.614785] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.615022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.805722] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.967666] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e in Status: SUCCESS [ 891.967843] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e deletion is rescheduled due to dependency. [ 891.967948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.053608] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.096312] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd996317-fb1b-4d07-a8c8-969fa47508ae in Status: SUCCESS [ 892.096312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.146029] env[65446]: INFO networking_nsxv3.common.synchronization [req-736acfa8-45a7-41b9-8284-ff6c32cfed65 req-a68393c2-2a2e-46c3-a8f4-8f8272f72680 tempest-ServerRescueTestJSON-779930602 tempest-ServerRescueTestJSON-779930602-project-member] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 892.146582] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 892.146972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.147133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.147204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.147416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.147598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.147725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.147796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.147969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.148072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.148178] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.251415] env[65446]: INFO networking_nsxv3.common.synchronization [req-f3225a8b-0fca-4941-bddb-80dd5e9a334d req-68f27cbc-f28f-4059-a427-b9ab0717cb9e tempest-AttachInterfacesUnderV243Test-1646901767 tempest-AttachInterfacesUnderV243Test-1646901767-project-member] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 892.252277] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGHEST for action security_group_members [ 892.252672] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.252783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.307891] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.308388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.308583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.308894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.309121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.309322] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 892.358252] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.358409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.358465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.358692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.358849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.368468] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 892.555567] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.652589] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.727890] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-874 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.728156] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.728322] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.729154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.729535] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.729738] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.729834] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.730310] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.730310] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.730427] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.730527] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.730636] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.730755] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.730851] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.730951] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.731458] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.751025] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.751025] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.751238] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.751454] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-874" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.751809] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-6c22ba5d-c443-4726-88a4-72eb1a3b286b taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.752047] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.752185] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.752548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.752725] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c22ba5d-c443-4726-88a4-72eb1a3b286b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.059066] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.059066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.059066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.059066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.059066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.059066] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 893.090511] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.090696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.090754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.091058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.091132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.101424] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 893.153738] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.255539] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.255903] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.256070] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.256510] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.256673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.256929] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 6c22ba5d-c443-4726-88a4-72eb1a3b286b not found, creating... [ 893.257335] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.257658] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.257825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.258197] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.258397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.260348] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.260348] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.260348] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.260348] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.260348] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.260348] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 6c22ba5d-c443-4726-88a4-72eb1a3b286b is going to be created. [ 893.304039] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.304039] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.304039] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.304319] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.304739] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.304845] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.657159] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.657310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.658629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.658629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.658629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.658629] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be updated. [ 893.687797] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.688034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.688124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.688387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.688534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.713519] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: IN_PROGRESS for 2s [ 894.022397] env[65446]: INFO networking_nsxv3.common.synchronization [req-736acfa8-45a7-41b9-8284-ff6c32cfed65 req-bcd958ea-8311-4a04-8404-e1371bf07d5d service nova] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_rules [ 894.022397] env[65446]: INFO networking_nsxv3.common.synchronization [req-736acfa8-45a7-41b9-8284-ff6c32cfed65 req-bcd958ea-8311-4a04-8404-e1371bf07d5d service nova] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 894.022397] env[65446]: INFO networking_nsxv3.common.synchronization [req-736acfa8-45a7-41b9-8284-ff6c32cfed65 req-bcd958ea-8311-4a04-8404-e1371bf07d5d service nova] Enqueued Resource ID: 6c22ba5d-c443-4726-88a4-72eb1a3b286b with Priority: HIGHEST for action port [ 894.022397] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_rules [ 894.022765] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 894.023096] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c22ba5d-c443-4726-88a4-72eb1a3b286b with Priority: HIGHEST for action port [ 894.024208] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.024594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.024796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.030884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.030884] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.031167] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.031462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.032113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c22ba5d-c443-4726-88a4-72eb1a3b286b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.033935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.034295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.034686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.034883] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c22ba5d-c443-4726-88a4-72eb1a3b286b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.386578] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.386578] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.386578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.386578] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.538307] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.538307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.540737] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c22ba5d-c443-4726-88a4-72eb1a3b286b with status ACTIVE [ 894.540737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.540737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.540737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.541835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.541835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.541835] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.542627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.542627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.542834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.542959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.543243] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.543517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.543517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.544197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.544625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.545362] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c22ba5d-c443-4726-88a4-72eb1a3b286b is going to be updated. [ 894.571689] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.571949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.572028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.572419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.572591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.572880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c22ba5d-c443-4726-88a4-72eb1a3b286b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.707263] env[65446]: INFO networking_nsxv3.common.synchronization [req-185023a0-86d0-459b-8ba2-d5e222871a49 req-8c326fb6-6fc5-48bc-9115-7b37e7c8791c tempest-InstanceActionsTestJSON-979795184 tempest-InstanceActionsTestJSON-979795184-project-member] Enqueued Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_members [ 894.708389] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_members [ 894.709601] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.709803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.709919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.710296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.710550] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.710715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.710820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.711074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.711214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.711366] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.887846] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.887999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.888073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.888282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.888476] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.888577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.888705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.888807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.888868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.888958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.889332] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.890029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.890029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.890029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.890029] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.890029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.890271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.890366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.890495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.890640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.890785] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.113918] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 895.114177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.114360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.114627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.115089] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.115089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.115089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.115246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.115336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.115521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.115648] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.116698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.116971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.117226] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.118076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.118076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.118076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.118076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.118076] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.216110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.216110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.216110] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d already deleted. [ 895.216110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.272955] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-721 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.273169] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-721" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.273333] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-721" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.273736] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-721" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.276183] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.276183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.276183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.276183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.276183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.276183] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.276183] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.276839] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.276839] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.276839] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.276839] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.276970] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.314267] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.314267] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.314267] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.314267] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-721" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.314267] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-a38d617d-9737-4566-ada9-6d6b306c0c09 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.314923] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.315235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.315878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.316180] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a38d617d-9737-4566-ada9-6d6b306c0c09',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.394222] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 895.416204] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.416470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.416594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.417089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.417247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.417654] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.417793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.417933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.418219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.418391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.418760] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.418936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.419137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.419401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.419541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.419844] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.420023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.420147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.420425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.420552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.420685] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 895.493274] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.493584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.493713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.494065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.494268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.510131] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 895.620113] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.621195] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.621330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.621398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.621612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.621705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.621892] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.621991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.622068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.622222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.622293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.622379] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 895.678042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.678187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.678750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.678750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.678750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.692471] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 895.727953] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 895.728111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.728338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.728611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.728868] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.729032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.729160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.729438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.729492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.729596] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.820525] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.820992] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.820992] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.821320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.821497] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.821667] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port a38d617d-9737-4566-ada9-6d6b306c0c09 not found, creating... [ 895.821964] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.822161] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.822318] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.823101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.823101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.823101] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.823343] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.823385] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.823590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.823749] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.823926] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: a38d617d-9737-4566-ada9-6d6b306c0c09 is going to be created. [ 895.848017] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.848280] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.848464] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.848848] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.849216] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.849559] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.125630] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 103a67fb-9e13-4b72-af0a-1870746747b1: rpc.has_security_group_logging(os_id): False [ 896.151727] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.152022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.152096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.152421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.152573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.152951] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.153127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.153242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.153484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.153608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.153742] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be updated. [ 896.227795] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.227998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.228105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.228410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.228618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.231977] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.259483] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: IN_PROGRESS for 2s [ 896.613287] env[65446]: INFO networking_nsxv3.common.synchronization [req-185023a0-86d0-459b-8ba2-d5e222871a49 req-31ccbf1b-49da-41ac-b3a1-89a21cb41645 service nova] Enqueued Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_rules [ 896.613287] env[65446]: INFO networking_nsxv3.common.synchronization [req-185023a0-86d0-459b-8ba2-d5e222871a49 req-31ccbf1b-49da-41ac-b3a1-89a21cb41645 service nova] Enqueued Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_members [ 896.613287] env[65446]: INFO networking_nsxv3.common.synchronization [req-185023a0-86d0-459b-8ba2-d5e222871a49 req-31ccbf1b-49da-41ac-b3a1-89a21cb41645 service nova] Enqueued Resource ID: a38d617d-9737-4566-ada9-6d6b306c0c09 with Priority: HIGHEST for action port [ 896.614519] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_rules [ 896.618035] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_members [ 896.618035] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38d617d-9737-4566-ada9-6d6b306c0c09 with Priority: HIGHEST for action port [ 896.618035] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.618035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.618035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.618270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.618404] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.620048] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.620048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.620048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.620537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.621152] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.621152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.621152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.621373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.621454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.621603] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.622902] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a38d617d-9737-4566-ada9-6d6b306c0c09 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.624126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.624126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.624126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.624328] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a38d617d-9737-4566-ada9-6d6b306c0c09',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.735623] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.129802] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.129802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.130113] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.130812] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a38d617d-9737-4566-ada9-6d6b306c0c09 with status ACTIVE [ 897.130992] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.131120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.131173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.131540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.131540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.131983] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.131983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.131983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.131983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.131983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.133417] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.133417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.133417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.133417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.133417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.133417] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a38d617d-9737-4566-ada9-6d6b306c0c09 is going to be updated. [ 897.156902] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.157073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.157132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.157337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.157465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.157627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a38d617d-9737-4566-ada9-6d6b306c0c09" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.239925] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.240143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.240210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.240384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.240477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.240575] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be updated. [ 897.308381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.308381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.308381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.308381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.308760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.322044] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: IN_PROGRESS for 2s [ 897.526599] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 897.526938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.634458] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.710373] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 897.710980] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 deletion is rescheduled due to dependency. [ 897.710980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.889350] env[65446]: INFO networking_nsxv3.common.synchronization [req-0f15133a-13a1-4c73-9271-1f290165653a req-94f05dd1-1c25-4b29-90d9-26ae64f9acff tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 897.889813] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 897.890174] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.890300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.890374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.891235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.891235] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.891235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.891235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.891235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.891557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.891557] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.138491] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.138688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.138739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.138992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.139121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.139226] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d is going to be created. [ 898.164115] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.164273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.164414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.164719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.164897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.176428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d in Status: UNINITIALIZED for 2s [ 898.280621] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103a67fb-9e13-4b72-af0a-1870746747b1 in Status: SUCCESS [ 898.281761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.394341] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.394341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.394341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.394543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.394543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.394748] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.395144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.395144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.395144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.395144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.395352] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 898.426755] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.426988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.427073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.427286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.427427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.437573] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 899.331971] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 899.332249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.332471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.332717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.332922] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.333347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.333347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.333347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.333347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.333519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.333552] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.836533] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.837425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.837425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.837425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.837425] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.837425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.837425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.837804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.837804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.837804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.837804] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.837949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.837949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.838104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.838241] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.838329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.838386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.838525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.838601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.838683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.838776] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.187370] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d in Status: SUCCESS [ 900.187641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.187864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.188128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.188346] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.188467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.188523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.188702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.188787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.188884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.188977] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.340982] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55137d38-b725-49e7-b742-3c0e3a6a4801: rpc.has_security_group_logging(os_id): False [ 900.360985] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.360985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.360985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.360985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.360985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.361260] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.361260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.361352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.361459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.361530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.361727] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.361908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.361979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.362155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.362234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.362912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.362912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.362912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.362912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.362912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.362912] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be updated. [ 900.431614] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.431834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.431941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.432304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.432576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.447325] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 900.447583] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 900.447766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.450053] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: IN_PROGRESS for 2s [ 900.691845] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.692066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.692145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.692389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.692568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.692682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.692734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.692895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.693225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.693225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.693225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.693507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.693507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.693507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.693639] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.693756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.693818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.693955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.694046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.695013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.695013] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.199745] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e409fe6a-de26-4e4b-88db-48ec1048ff2d: rpc.has_security_group_logging(os_id): False [ 901.226946] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.227132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.227176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.227496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.227592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.227801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.227942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.228019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.228182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.228261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.228455] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.228550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.228612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.228753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.228841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.229089] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.229170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.229208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.229361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.229418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.229504] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d is going to be created. [ 901.300268] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.300496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.300496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.300770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.301018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.313879] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d in Status: IN_PROGRESS for 2s [ 901.858686] env[65446]: INFO networking_nsxv3.common.synchronization [req-7428df52-e44c-497f-b514-0b17d9fe8351 req-3b5e9e6d-79f4-4387-816d-4fd096dceeb3 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 901.859268] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 901.859578] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.859734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.859768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.859945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.860419] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.860570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.860664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.860890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.861056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.861205] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.146063] env[65446]: INFO networking_nsxv3.common.synchronization [req-d652283b-d3f8-43f8-82f3-111b9b068780 req-2cedc51d-37b2-41c0-b444-64dbf1116441 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 902.146607] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 902.147019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.147297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.147363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.147623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.147795] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.147906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.147962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.148891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.148891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.148891] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.365146] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.484988] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 902.485338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.572216] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.572501] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.572690] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.573129] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.574178] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.574464] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.574656] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.574998] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.575244] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.575537] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.575736] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.576029] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.576211] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.576427] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.576604] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.576879] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.605928] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.606154] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.606281] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.606525] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.606984] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.607215] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.607326] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.607670] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.608051] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8473231c-3e01-4f9d-a2e1-f3c7e66e3d97',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.651314] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.651504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.651504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.651831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.651946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.652309] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.652640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.652732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.652942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.653043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.653146] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 already deleted. [ 902.653274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.867911] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.112878] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.112878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.112878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.112878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.112878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.112878] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 not found, creating... [ 903.112878] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.113210] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.113210] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.113367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.113505] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.113924] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.114203] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.114349] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.114590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.114780] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.114970] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 is going to be created. [ 903.139011] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.139011] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.139206] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.139438] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.139735] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.139983] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.337155] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d in Status: SUCCESS [ 903.337496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.370252] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.370415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.370490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.370713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.370810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.370919] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 903.408307] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.408307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.408447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.408709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.409336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.420572] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 903.825120] env[65446]: INFO networking_nsxv3.common.synchronization [req-d652283b-d3f8-43f8-82f3-111b9b068780 req-87c9f1fd-3724-40fc-819c-3000fca4239a service nova] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 903.825431] env[65446]: INFO networking_nsxv3.common.synchronization [req-d652283b-d3f8-43f8-82f3-111b9b068780 req-87c9f1fd-3724-40fc-819c-3000fca4239a service nova] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 903.825514] env[65446]: INFO networking_nsxv3.common.synchronization [req-d652283b-d3f8-43f8-82f3-111b9b068780 req-87c9f1fd-3724-40fc-819c-3000fca4239a service nova] Enqueued Resource ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with Priority: HIGHEST for action port [ 903.826151] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 903.826313] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 903.826437] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with Priority: HIGHEST for action port [ 903.826851] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.827183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.827304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.827609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.827718] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.829587] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.829717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.829788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.830356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.831366] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.832131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.832416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.832416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.832526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.833254] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.833471] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.833576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.833640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.833795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.833867] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8473231c-3e01-4f9d-a2e1-f3c7e66e3d97',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.335946] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.335946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.337366] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.338659] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with status ACTIVE [ 904.338771] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.338854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.338922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.339212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.339298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.339714] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.339714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.339714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.339888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.339888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.340235] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.340391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.340471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.340595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.340659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.340840] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 is going to be updated. [ 904.376250] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.376587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.376656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.377092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.377302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.377434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.842718] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.344818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.345171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.345171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.345369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.345462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.345595] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be created. [ 905.372662] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.372896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.372978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.373272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.373528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.385741] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: UNINITIALIZED for 2s [ 905.432776] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 905.433029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.640153] env[65446]: INFO networking_nsxv3.common.synchronization [req-8e2e741f-9856-4db0-9499-e4669a941952 req-c78945b9-2398-4236-80c1-605e621e9080 tempest-MigrationsAdminTest-1736177509 tempest-MigrationsAdminTest-1736177509-project-member] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 906.640830] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGHEST for action security_group_members [ 906.640984] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.641177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.641280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.641549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.641767] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.641911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.642020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.642307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.642438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.642571] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.145656] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.145839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.145905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.146290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.146408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.146629] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.146737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.146831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.147072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.147210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.147463] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be updated. [ 907.181816] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.181982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.182073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.182326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.182477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.195656] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: IN_PROGRESS for 2s [ 907.335433] env[65446]: INFO networking_nsxv3.common.synchronization [req-816fb418-a15d-4901-88da-bfd785cc8f97 req-11572c79-31e4-41e6-a858-3abe8ab3f1b6 tempest-FloatingIPsAssociationTestJSON-2100177048 tempest-FloatingIPsAssociationTestJSON-2100177048-project-member] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 907.336876] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGHEST for action security_group_members [ 907.336876] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.336876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.336876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.337117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.337237] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.337363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.337452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.337665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.337776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.337912] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.400076] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 907.400397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.400569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.400787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.400986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.401120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.401186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.401626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.401626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.401626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.401626] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.840905] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.840905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.840905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.841389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.841389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.841471] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.841560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.841634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.841828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.841916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.842021] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be updated. [ 907.871811] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.872094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.872094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.872976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.872976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.882883] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: IN_PROGRESS for 2s [ 907.904056] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.904269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.904352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.904615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.904879] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.905032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.905108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.905313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.905406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.905509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.905661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.905833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.905833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.906416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.906416] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.906416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.906416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.906416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.906627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.906627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.906683] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.409498] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d360f67e-96d2-41e3-87bd-00f87fb4fd70: rpc.has_security_group_logging(os_id): False [ 908.428884] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.429082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.429142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.429490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.429619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.429869] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.429971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.430043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.430299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.430394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.430606] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.430700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.430761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.430906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.430994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.431210] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.431344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.431378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.431536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.431623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.431965] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be created. [ 908.506519] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.506519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.506519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.507182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.507182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.519276] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 909.206928] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 in Status: SUCCESS [ 909.207245] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 deletion is rescheduled due to dependency. [ 909.207447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.894793] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 in Status: SUCCESS [ 909.895011] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 deletion is rescheduled due to dependency. [ 909.895559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.535252] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 910.535644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.009232] env[65446]: INFO networking_nsxv3.common.synchronization [req-0a8d95c7-d732-459e-8d08-ab0d34f171d0 req-2df60f65-490f-41ab-9036-55741615f276 tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 911.009882] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 911.010312] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.010473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.010570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.010959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.010959] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.011160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.011160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.011313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.011420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.011585] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.437499] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.437638] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.437749] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.438125] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.438453] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.438605] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.438711] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.438993] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.439182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.439442] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.439564] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.439679] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.439796] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.439916] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.440035] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.440229] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.466668] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.467128] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.469030] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.469030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-403" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.469030] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-02364ede-5f08-4da9-8b30-654458eeb2c1 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.469030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.469030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.469030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.469030] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02364ede-5f08-4da9-8b30-654458eeb2c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.517129] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.517129] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.517129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.517129] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 911.545179] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.545574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.545574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.545671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.545725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.557326] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 911.972147] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.972147] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.972392] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.972446] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.972593] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.972743] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 02364ede-5f08-4da9-8b30-654458eeb2c1 not found, creating... [ 911.973036] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.973198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.973327] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.973528] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.973661] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.973950] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.974123] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.974238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.974517] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.974933] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.975367] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 02364ede-5f08-4da9-8b30-654458eeb2c1 is going to be created. [ 912.003595] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.004748] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.005124] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.005379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.006053] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.007439] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.737998] env[65446]: INFO networking_nsxv3.common.synchronization [req-0a8d95c7-d732-459e-8d08-ab0d34f171d0 req-111ace68-48bb-4a4b-93f0-4fdd7648ce4c service nova] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_rules [ 912.738359] env[65446]: INFO networking_nsxv3.common.synchronization [req-0a8d95c7-d732-459e-8d08-ab0d34f171d0 req-111ace68-48bb-4a4b-93f0-4fdd7648ce4c service nova] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 912.738421] env[65446]: INFO networking_nsxv3.common.synchronization [req-0a8d95c7-d732-459e-8d08-ab0d34f171d0 req-111ace68-48bb-4a4b-93f0-4fdd7648ce4c service nova] Enqueued Resource ID: 02364ede-5f08-4da9-8b30-654458eeb2c1 with Priority: HIGHEST for action port [ 912.739431] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_rules [ 912.739621] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 912.739826] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02364ede-5f08-4da9-8b30-654458eeb2c1 with Priority: HIGHEST for action port [ 912.740238] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.740462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.740462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.740744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.740744] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.741970] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.741970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.743183] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-02364ede-5f08-4da9-8b30-654458eeb2c1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.743301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.743385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.743604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.743723] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02364ede-5f08-4da9-8b30-654458eeb2c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.248257] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.251207] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02364ede-5f08-4da9-8b30-654458eeb2c1 with status ACTIVE [ 913.251207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.251207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.251207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.251207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.251944] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02364ede-5f08-4da9-8b30-654458eeb2c1 is going to be updated. [ 913.272086] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.272086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.272254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.272344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.272513] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.272686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02364ede-5f08-4da9-8b30-654458eeb2c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.514621] env[65446]: INFO networking_nsxv3.common.synchronization [None req-f04c85d1-776f-4f48-b14f-8aee0de725d8 None None] Enqueued Resource ID: 85bd7f2d-956b-4964-9dd1-a7b302254e9e with Priority: HIGHEST for action port [ 913.515204] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85bd7f2d-956b-4964-9dd1-a7b302254e9e with Priority: HIGHEST for action port [ 913.515523] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-85bd7f2d-956b-4964-9dd1-a7b302254e9e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.515633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85bd7f2d-956b-4964-9dd1-a7b302254e9e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.515715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85bd7f2d-956b-4964-9dd1-a7b302254e9e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.516139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85bd7f2d-956b-4964-9dd1-a7b302254e9e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.516139] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85bd7f2d-956b-4964-9dd1-a7b302254e9e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.572032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 913.572032] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 deletion is rescheduled due to dependency. [ 913.572032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.572032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.572032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.572032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.572032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.572032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.572032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.572032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.572032] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.722152] env[65446]: INFO networking_nsxv3.common.synchronization [req-07082084-588e-4fca-a7e8-413502e18aa5 req-37166dee-1f96-4f0a-ad35-d6ede3a917d7 tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 913.722715] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 913.723665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.724034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.724034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.724213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.724409] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.724542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.724839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.724839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.724935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.725071] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.022491] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85bd7f2d-956b-4964-9dd1-a7b302254e9e [ 914.022491] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.022491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.022491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.022491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.022491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.022491] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85bd7f2d-956b-4964-9dd1-a7b302254e9e already deleted. [ 914.022491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85bd7f2d-956b-4964-9dd1-a7b302254e9e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.073709] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.084721] env[65446]: INFO networking_nsxv3.common.synchronization [req-942fcfc1-03c5-45fc-82c9-03b5997ca5e7 req-25a4f88e-2f7e-4502-9d6e-5993659e8dd2 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 914.084721] env[65446]: INFO networking_nsxv3.common.synchronization [req-942fcfc1-03c5-45fc-82c9-03b5997ca5e7 req-25a4f88e-2f7e-4502-9d6e-5993659e8dd2 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 914.084721] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 914.084721] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 914.084721] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.084721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.084721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.084721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.084721] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.084721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.084721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.084721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.084721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.085830] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.085830] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.085967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.085967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.086190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.086332] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.086421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.086479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.086616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.086689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.086772] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.164137] env[65446]: INFO networking_nsxv3.common.synchronization [req-942fcfc1-03c5-45fc-82c9-03b5997ca5e7 req-25a4f88e-2f7e-4502-9d6e-5993659e8dd2 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_rules [ 914.164137] env[65446]: INFO networking_nsxv3.common.synchronization [req-942fcfc1-03c5-45fc-82c9-03b5997ca5e7 req-25a4f88e-2f7e-4502-9d6e-5993659e8dd2 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 914.164137] env[65446]: INFO networking_nsxv3.common.synchronization [req-942fcfc1-03c5-45fc-82c9-03b5997ca5e7 req-25a4f88e-2f7e-4502-9d6e-5993659e8dd2 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 914.164137] env[65446]: INFO networking_nsxv3.common.synchronization [req-942fcfc1-03c5-45fc-82c9-03b5997ca5e7 req-25a4f88e-2f7e-4502-9d6e-5993659e8dd2 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 914.164783] env[65446]: INFO networking_nsxv3.common.synchronization [req-942fcfc1-03c5-45fc-82c9-03b5997ca5e7 req-25a4f88e-2f7e-4502-9d6e-5993659e8dd2 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with Priority: HIGHEST for action port [ 914.166762] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_rules [ 914.166762] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 914.166762] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with Priority: HIGHEST for action port [ 914.167287] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 914.170248] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 914.170248] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.170248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.170248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.170248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.170248] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.171967] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.171967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.171967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.173097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.173097] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.173316] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.173684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.173684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.175136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.175303] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8473231c-3e01-4f9d-a2e1-f3c7e66e3d97',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.178662] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.178662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.178805] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.178893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.195245] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.195900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.195900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.195900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.196290] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.196456] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.197038] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.197038] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.197038] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.197833] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.197833] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.197833] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.197833] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.197833] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.198064] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.198250] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.229643] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.229937] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 914.230109] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.230403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.230750] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-799d796d-3dcd-4534-aadc-c393d011e319 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.231446] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.231446] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.231702] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.231884] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799d796d-3dcd-4534-aadc-c393d011e319',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.234297] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.234297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.234297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.234297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.234297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.234297] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.234848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.234848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.234848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.234967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.235022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 914.270551] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.270551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.270551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.270551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.270551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.282207] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 914.579791] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.590059] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.590059] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.681448] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.681971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.682551] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.682921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.684495] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with status ACTIVE [ 914.685118] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.685475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.685701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.686122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.686385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.686758] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.687083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.688065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.688526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.688742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.689113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.689525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.689710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.690038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.690276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.691399] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 is going to be updated. [ 914.718186] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.718404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.718458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.718732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.718965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.719173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.735159] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.735341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.735460] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.736560] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.736560] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.736560] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 799d796d-3dcd-4534-aadc-c393d011e319 not found, creating... [ 914.736877] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.738101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.738413] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.739096] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.739497] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.740022] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.740249] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.740397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.740693] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.740870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.741040] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 799d796d-3dcd-4534-aadc-c393d011e319 is going to be created. [ 914.771971] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.772372] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.772471] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.772765] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.773013] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.773267] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.079694] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 915.080120] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 915.080120] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_members [ 915.080730] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.080730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.080730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.081181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.081181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.081181] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 915.082406] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 915.082535] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 915.082630] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_members [ 915.082915] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.083014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.083222] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.083297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.083471] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef2378e4-6034-4c52-b983-3b0244de565d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.083583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.083643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.083858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.084015] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.084112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.084172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.084327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.084411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.084507] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.093994] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.094815] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.122051] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.122051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.122393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.122393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.122505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.135566] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 915.182925] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_rules [ 915.183274] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 915.183550] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 915.183804] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 915.184078] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_rules [ 915.184351] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_members [ 915.184600] env[65446]: INFO networking_nsxv3.common.synchronization [req-bd0a77c4-6e5c-4108-9ba2-ba82970d3003 req-778dcba7-4b84-41ee-b90c-25069a37cb73 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with Priority: HIGHEST for action port [ 915.185438] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_rules [ 915.185653] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 915.185823] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_members [ 915.186016] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with Priority: HIGHEST for action port [ 915.186210] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_rules [ 915.186383] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 915.186544] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 915.186986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.187241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.187523] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.187630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.187871] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef2378e4-6034-4c52-b983-3b0244de565d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.187994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.188355] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.188524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.188645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.188956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.189130] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8473231c-3e01-4f9d-a2e1-f3c7e66e3d97',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.191223] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef2378e4-6034-4c52-b983-3b0244de565d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.191365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.191433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.191651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.191728] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.192886] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.192992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.193180] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.193269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.534145] env[65446]: INFO networking_nsxv3.common.synchronization [req-07082084-588e-4fca-a7e8-413502e18aa5 req-d5851e80-02fd-4131-8f54-5e4eff5ba3c9 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 915.534351] env[65446]: INFO networking_nsxv3.common.synchronization [req-07082084-588e-4fca-a7e8-413502e18aa5 req-d5851e80-02fd-4131-8f54-5e4eff5ba3c9 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 915.534496] env[65446]: INFO networking_nsxv3.common.synchronization [req-07082084-588e-4fca-a7e8-413502e18aa5 req-d5851e80-02fd-4131-8f54-5e4eff5ba3c9 service nova] Enqueued Resource ID: 799d796d-3dcd-4534-aadc-c393d011e319 with Priority: HIGHEST for action port [ 915.536640] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 915.536640] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 915.536640] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799d796d-3dcd-4534-aadc-c393d011e319 with Priority: HIGHEST for action port [ 915.536640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.536640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.536640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.536640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.536908] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.538867] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.538989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.539568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-799d796d-3dcd-4534-aadc-c393d011e319 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.539900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.539900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.540091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.540155] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799d796d-3dcd-4534-aadc-c393d011e319',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.587553] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.596683] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.596980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.597133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.597439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.597572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.597731] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 915.599889] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.600145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.600184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.600890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.601152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.601270] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be created. [ 915.633563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.633563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.633563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.633813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.634229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.636852] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.636852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.636852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.637060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.637194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.652797] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 915.653568] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: UNINITIALIZED for 2s [ 915.694747] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef2378e4-6034-4c52-b983-3b0244de565d taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.695035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.695539] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 with status ACTIVE [ 915.695768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.695865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.695903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.696142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.696234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.696414] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.696514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.696581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.696723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.696796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.697037] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.697140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.697203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.697349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.697425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.697510] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8473231c-3e01-4f9d-a2e1-f3c7e66e3d97 is going to be updated. [ 915.724564] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.724721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.724791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.725123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.725278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.725471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8473231c-3e01-4f9d-a2e1-f3c7e66e3d97" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.039768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.040126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.042523] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 799d796d-3dcd-4534-aadc-c393d011e319 with status ACTIVE [ 916.043449] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.043449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.043449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.044106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.044106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.044106] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.044304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.044304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.044393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.044475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.044747] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.044832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.044950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.045111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.045178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.045296] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 799d796d-3dcd-4534-aadc-c393d011e319 is going to be updated. [ 916.070949] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.071049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.071128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.071345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.071469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.071628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-799d796d-3dcd-4534-aadc-c393d011e319" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.092415] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.293917] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 916.293917] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 916.293917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.294133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.294308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.295460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.295460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.295617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.296480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.296480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.296480] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.596777] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.597184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.597184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.597318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.597472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.597775] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef2378e4-6034-4c52-b983-3b0244de565d is going to be created. [ 916.628879] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.629133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.629621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.629913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.631198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.644473] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: UNINITIALIZED for 2s [ 916.771073] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7eb80799-ad78-4484-bd86-05a0d2ecb479 None None] Enqueued Resource ID: 82304270-5945-4290-9036-6607d63072b5 with Priority: HIGHEST for action port [ 916.771529] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82304270-5945-4290-9036-6607d63072b5 with Priority: HIGHEST for action port [ 916.771835] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-82304270-5945-4290-9036-6607d63072b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.771956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82304270-5945-4290-9036-6607d63072b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.772410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82304270-5945-4290-9036-6607d63072b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.772684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82304270-5945-4290-9036-6607d63072b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.772770] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82304270-5945-4290-9036-6607d63072b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.798299] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.151730] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 917.152170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.153591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.153857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.155474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.155687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.155918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.156148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.156448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.156448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.156571] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.275347] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82304270-5945-4290-9036-6607d63072b5 [ 917.275885] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.275996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.276160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.276441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.276803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.276803] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82304270-5945-4290-9036-6607d63072b5 already deleted. [ 917.276955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82304270-5945-4290-9036-6607d63072b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.302360] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.661650] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.663259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.663396] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.663670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.664341] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.664505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.664573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.664861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.664955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.665064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.665259] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.665360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.665422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.665634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.665749] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.665845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.665923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.666084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.666183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.666271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.666366] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.668996] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 917.669266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.671166] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: SUCCESS [ 917.671371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.671562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.671782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.671982] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.672129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.672196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.672355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.672435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.672529] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.673440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.673607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.673794] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.673911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.673977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.674129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.674225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.674317] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.805561] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.805754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.805796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.806048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.806140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.806239] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 917.837864] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.838105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.838105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.838317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.838464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.849453] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 917.937365] env[65446]: INFO networking_nsxv3.common.synchronization [req-b1fc8de7-01cb-40eb-b4bb-657347689be9 req-ece38ec2-0afc-427f-b71e-46951c2da918 tempest-InstanceActionsTestJSON-979795184 tempest-InstanceActionsTestJSON-979795184-project-member] Enqueued Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_members [ 917.937938] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGHEST for action security_group_members [ 917.944178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.944178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.944178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.944178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.944178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.944178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.944178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.944178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.944178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.944876] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.177860] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.179051] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea407653-fe6d-49fc-ae9f-5964f5403512: rpc.has_security_group_logging(os_id): False [ 918.180234] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.201781] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.202132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.202132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.202273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.202426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.202782] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.202886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.202886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.203062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.203144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.203330] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.203460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.203556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.203765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.203862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.208616] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.208824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.208906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.209108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.209222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.209358] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 918.333268] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.333436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.333660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.333753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.333911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.359616] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 918.447371] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.447371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.447371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.447589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.447621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.447813] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.447920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.447968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.448143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.448228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.448303] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d is going to be updated. [ 918.522133] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.522133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.522133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.522133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.522133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.534972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d in Status: IN_PROGRESS for 2s [ 918.578081] env[65446]: INFO networking_nsxv3.common.synchronization [req-8dff61bb-003c-4619-94ee-4f796d8f4a72 req-e178563d-dd0e-4f60-865d-0a4d38a9f409 tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 918.578081] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 918.578081] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.578081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.578081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.578081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.583589] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.584070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.584340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.584669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.584880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.585095] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.662036] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: SUCCESS [ 918.662036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.662036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.662036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.662036] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.662036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.662036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.662036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.662036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.662036] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.689053] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.689053] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.088952] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.089162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.089231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.089461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.089598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.089822] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.089944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.090070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.090232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.090334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.090436] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 919.137162] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.137419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.137419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.137612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.137771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.152392] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 919.169054] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.191568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.192321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.192321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.192876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.192876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.192992] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 919.194383] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.194556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.194556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.194732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.194871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.194930] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be updated. [ 919.229019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.229019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.229019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.241020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: IN_PROGRESS for 2s [ 919.241020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 919.671125] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.860287] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 919.860617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.860742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.861008] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.861229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.861357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.861433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.861628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.861826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.861826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.861918] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.174400] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.174561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.174658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.174869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.174961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.175073] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef2378e4-6034-4c52-b983-3b0244de565d is going to be updated. [ 920.205970] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.206262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.206262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.206593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.206765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.218940] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: IN_PROGRESS for 2s [ 920.365910] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.365910] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.365910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.366398] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.366398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.366398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.366398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.366398] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.367248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.367248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.367248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.367248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.367248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.367248] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.378996] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 920.378996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.547565] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d in Status: SUCCESS [ 920.547751] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d deletion is rescheduled due to dependency. [ 920.547879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.870085] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184: rpc.has_security_group_logging(os_id): False [ 920.904314] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.904314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.904314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.904314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.904314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.904647] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.904647] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.904647] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.904830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.904971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.905240] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.905388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.905456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.905609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.905686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.905890] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.905986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.906161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.906319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.906399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.906488] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 921.016677] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.016677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.017089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.017089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.017783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.033907] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 921.163506] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 921.163839] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 deletion is rescheduled due to dependency. [ 921.164017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.259281] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 921.259281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.259841] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: SUCCESS [ 921.259841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.259841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.259974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.260117] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.260311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.260311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.260491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.260570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.260656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.260954] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.261881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.262087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.262291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.262469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.262575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.262807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.262931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.263090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.263241] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.264832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.265056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.265314] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.265480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.265581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.265776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.265886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.265995] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.268118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.268215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.268444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.268558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.268623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.268781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.268865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.268961] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.766840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.767156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.770625] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.771949] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.773051] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.217194] env[65446]: INFO networking_nsxv3.common.synchronization [None req-adab2d87-fbf0-42e9-b2e9-821aeb199133 None None] Enqueued Resource ID: a514deaf-258a-48d7-8672-7cbd85a8aff7 with Priority: HIGHEST for action port [ 922.218272] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a514deaf-258a-48d7-8672-7cbd85a8aff7 with Priority: HIGHEST for action port [ 922.218272] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a514deaf-258a-48d7-8672-7cbd85a8aff7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.218272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a514deaf-258a-48d7-8672-7cbd85a8aff7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.218272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a514deaf-258a-48d7-8672-7cbd85a8aff7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.218638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a514deaf-258a-48d7-8672-7cbd85a8aff7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.218638] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a514deaf-258a-48d7-8672-7cbd85a8aff7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.230702] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: SUCCESS [ 922.230702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.230702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.230702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.231047] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.231047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.231047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.231047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.231266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.231266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.231347] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.275286] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ae8301c-ec7c-4370-9c48-81411fb3a144: rpc.has_security_group_logging(os_id): False [ 922.276994] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.278348] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.299458] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.299458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.299458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.299723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.299723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.300797] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.300797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.300797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.301127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.301235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.301336] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be created. [ 922.369056] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.369301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.369301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.369680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.369680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.387129] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: IN_PROGRESS for 2s [ 922.724599] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a514deaf-258a-48d7-8672-7cbd85a8aff7 [ 922.725039] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.725198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.725349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.725642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.728427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.728516] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a514deaf-258a-48d7-8672-7cbd85a8aff7 already deleted. [ 922.728916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a514deaf-258a-48d7-8672-7cbd85a8aff7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.741994] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.781141] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.781360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.781469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.781716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.781821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.781929] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be updated. [ 922.783293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.783410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.783474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.784463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.784560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.784657] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 922.817744] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.817891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.817961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.819010] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.819010] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.822121] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.822121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.822121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.822275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.822428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.835313] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: IN_PROGRESS for 2s [ 922.835313] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 922.949630] env[65446]: INFO networking_nsxv3.common.synchronization [req-e67ef8c7-cb0f-472e-b675-10b725fc08e3 req-b0ec4f29-4c53-4ff7-9a96-5c4c90e37213 tempest-ServerRescueTestJSON-779930602 tempest-ServerRescueTestJSON-779930602-project-member] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 922.949745] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 922.950743] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.950946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.951096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.951322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.951593] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.951690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.951817] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.952020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.956086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.956236] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.050890] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 923.051143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.192628] env[65446]: INFO networking_nsxv3.common.synchronization [req-b6d447b5-005c-402d-9c97-9e5f418e1e4e req-c4bb59b6-650c-4656-bbaf-4df6b3d5240e tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 923.193356] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 923.193497] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.193622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.193680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.193878] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.194487] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.194487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.194487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.194487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.194487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.194487] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.248878] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef2378e4-6034-4c52-b983-3b0244de565d: rpc.has_security_group_logging(os_id): False [ 923.269349] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.269558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.269611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.270489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.270609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.270884] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.271084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.271084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.271272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.271370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.271449] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef2378e4-6034-4c52-b983-3b0244de565d is going to be created. [ 923.362255] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.362577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.362577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.362685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.362865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.375756] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: IN_PROGRESS for 2s [ 923.464173] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.697075] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.967459] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.201217] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.401740] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: SUCCESS [ 924.401740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.401740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.402845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.402845] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.470911] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.472085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.472085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.472085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.472085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.472085] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be updated. [ 924.504541] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.504770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.506495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.506856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.507077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.522229] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: IN_PROGRESS for 2s [ 924.557329] env[65446]: INFO networking_nsxv3.common.synchronization [req-c81182bc-dc49-41f7-b0b7-649f3c418472 req-870f7fa4-5259-4541-a260-604e94e58824 tempest-ServersNegativeTestJSON-1295958692 tempest-ServersNegativeTestJSON-1295958692-project-member] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 924.558467] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 924.558827] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.558949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.559024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.559324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.559485] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.559584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.559644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.559790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.559870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.559961] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.705143] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.705143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.705143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.705143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.705143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.705143] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 924.748215] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.748215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.748215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.748215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.748215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.757112] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 924.845979] env[65446]: INFO networking_nsxv3.common.synchronization [None req-eb5731f3-0ac4-44a3-b691-0f87fc61f471 None None] Enqueued Resource ID: 96f87bf5-ee12-4708-8962-b44fd739721b with Priority: HIGHEST for action port [ 924.850414] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 924.850414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.850414] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: SUCCESS [ 924.850414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.850414] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96f87bf5-ee12-4708-8962-b44fd739721b with Priority: HIGHEST for action port [ 924.850692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.850692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.850925] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.851495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.851495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.851495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.851495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.851671] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.854421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.854421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.854526] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.854576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.854609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.854747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.854824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.854956] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.856249] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-96f87bf5-ee12-4708-8962-b44fd739721b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.856249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96f87bf5-ee12-4708-8962-b44fd739721b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.856410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96f87bf5-ee12-4708-8962-b44fd739721b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.856592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96f87bf5-ee12-4708-8962-b44fd739721b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.856701] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96f87bf5-ee12-4708-8962-b44fd739721b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.906667] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.906667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.062941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.063740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.067018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.067018] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f already deleted. [ 925.067018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.070450] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.070687] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.070854] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.073825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.073825] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.073825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.073825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.073825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.073825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.073825] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.073825] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.073825] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.073825] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.073825] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.073825] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.073825] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.098383] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.098617] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.098672] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.098832] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.099284] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-c79021b8-f526-42e3-a71b-2ef1136f2c89 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.099623] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.099623] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.099931] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.100060] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c79021b8-f526-42e3-a71b-2ef1136f2c89',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.374521] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.374521] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.374521] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96f87bf5-ee12-4708-8962-b44fd739721b [ 925.374521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.374521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.374521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.374521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.374521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.374521] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96f87bf5-ee12-4708-8962-b44fd739721b already deleted. [ 925.374521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96f87bf5-ee12-4708-8962-b44fd739721b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.392243] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: SUCCESS [ 925.392243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.602306] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.602848] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.602848] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.602977] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.603074] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.603231] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port c79021b8-f526-42e3-a71b-2ef1136f2c89 not found, creating... [ 925.603485] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.603644] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.603760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.604007] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.604150] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.604425] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.604639] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.605269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.605269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.605269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.605269] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 is going to be created. [ 925.630061] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.630312] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.630685] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.630812] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.630967] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.631315] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.859093] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.860999] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.293643] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c5545c50-2628-4d9b-9976-257f57c249ef None None] Enqueued Resource ID: 59304210-4019-46da-b872-80652f2d1df7 with Priority: HIGHEST for action port [ 926.293643] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59304210-4019-46da-b872-80652f2d1df7 with Priority: HIGHEST for action port [ 926.293886] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-59304210-4019-46da-b872-80652f2d1df7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.293886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59304210-4019-46da-b872-80652f2d1df7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.293886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59304210-4019-46da-b872-80652f2d1df7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.296353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59304210-4019-46da-b872-80652f2d1df7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.296353] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59304210-4019-46da-b872-80652f2d1df7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.328879] env[65446]: INFO networking_nsxv3.common.synchronization [req-c81182bc-dc49-41f7-b0b7-649f3c418472 req-e81517e2-458e-48fd-890d-dcb0cc37eb9c service nova] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_rules [ 926.328879] env[65446]: INFO networking_nsxv3.common.synchronization [req-c81182bc-dc49-41f7-b0b7-649f3c418472 req-e81517e2-458e-48fd-890d-dcb0cc37eb9c service nova] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 926.328879] env[65446]: INFO networking_nsxv3.common.synchronization [req-c81182bc-dc49-41f7-b0b7-649f3c418472 req-e81517e2-458e-48fd-890d-dcb0cc37eb9c service nova] Enqueued Resource ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 with Priority: HIGHEST for action port [ 926.330270] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_rules [ 926.330413] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 926.330519] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 with Priority: HIGHEST for action port [ 926.330869] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.331043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.331098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.331332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.331419] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.336191] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.336322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.336391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.336770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.336770] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.337027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.337027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.337359] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.338182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.338286] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.339532] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c79021b8-f526-42e3-a71b-2ef1136f2c89 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.339671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.339833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.340884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.340884] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c79021b8-f526-42e3-a71b-2ef1136f2c89',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.361016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.361186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.361256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.361509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.361739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.361739] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 926.363279] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.363411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.363449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.363651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.363735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.363825] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be updated. [ 926.394753] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.394753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.394998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.394998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.395165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.396845] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.397351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.397351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.397607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.397756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.406890] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: IN_PROGRESS for 2s [ 926.407652] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 926.534767] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 926.535054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.768284] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 926.768643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.797187] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59304210-4019-46da-b872-80652f2d1df7 [ 926.797476] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.797637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.797711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.797946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.798079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.798193] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59304210-4019-46da-b872-80652f2d1df7 already deleted. [ 926.798294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59304210-4019-46da-b872-80652f2d1df7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.823665] env[65446]: INFO networking_nsxv3.common.synchronization [req-523c5362-8932-4a46-b25c-c17e51957315 req-beffb081-3ab8-4c61-9413-c1a295f4425c tempest-ImagesOneServerNegativeTestJSON-1601333446 tempest-ImagesOneServerNegativeTestJSON-1601333446-project-member] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 926.824225] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGHEST for action security_group_members [ 926.824546] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.824640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.824711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.824915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.825329] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.825446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.825507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.825669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.825753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.825846] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.827951] env[65446]: INFO networking_nsxv3.common.synchronization [req-f5656b8f-029f-4537-97e7-1280c81da3e1 req-ffa2b794-56b0-4052-b53e-198c8c2e89b6 tempest-ServerActionsV293TestJSON-141987590 tempest-ServerActionsV293TestJSON-141987590-project-member] Enqueued Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_members [ 926.828350] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGHEST for action security_group_members [ 926.828817] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.828926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.828993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.829162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.829376] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.829489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.829552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.829693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.829771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.829859] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.838584] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.838584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.844458] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.847192] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c79021b8-f526-42e3-a71b-2ef1136f2c89 with status ACTIVE [ 926.847386] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.847501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.847570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.847805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.847878] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.848031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.848150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.849370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.849370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.849370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.849370] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.849370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.849370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.849370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.849370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.849370] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 is going to be updated. [ 926.872123] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.872268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.872337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.876195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.876361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.876521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.293956] env[65446]: INFO networking_nsxv3.common.synchronization [req-0daeaba5-f89c-45e2-9266-9534f6138f54 req-53807c7a-1cbe-453e-a0b2-8d95954c8f68 tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 927.296021] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 927.296021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.296021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.296021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.296021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.296536] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.296847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.297086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.297442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.297683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.297942] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.328971] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.329498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.329590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.329814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.329902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.330174] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.330323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.330399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.330538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.330612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.330698] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be updated. [ 927.333380] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.333509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.333561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.333773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.333855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.334089] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.334183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.334249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.334396] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.334530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.334581] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 is going to be updated. [ 927.354417] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.366286] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.366641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.366641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.366738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.368074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.371200] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.371313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.371524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.371733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.371894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.382653] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 in Status: IN_PROGRESS for 2s [ 927.383337] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: IN_PROGRESS for 2s [ 927.627684] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7db8e1e0-3763-4fb8-8ba5-21e0d186b13e tempest-ServersTestJSON-1390728580 tempest-ServersTestJSON-1390728580-project-member] Enqueued Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_rules [ 927.628291] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_rules [ 927.628620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.628748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.628821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.632463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.632580] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.712785] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.713025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.713235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.713437] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.713707] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.713868] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.713985] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.714220] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.714365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.714570] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.714682] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.714803] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.714911] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.715198] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.715352] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.715896] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.739044] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.739210] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.739310] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.739632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.740584] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-445ffe86-e4b7-46fb-bd82-bf64827e2fef taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.740584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.740584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.740584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.740584] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('445ffe86-e4b7-46fb-bd82-bf64827e2fef',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.787106] env[65446]: INFO networking_nsxv3.common.synchronization [None req-01fff366-4d72-4391-a688-0ff93db0627f tempest-ServersTestJSON-1390728580 tempest-ServersTestJSON-1390728580-project-member] Enqueued Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_rules [ 927.787657] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_rules [ 927.788918] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.788918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.800497] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.800630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.800675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.800956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.800956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.801174] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.801274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.801337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.801689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.801689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.801689] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 927.828933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.829104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.829177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.829566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.829719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.840099] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 927.858714] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.858875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.858940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.859280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.859383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.859527] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be created. [ 927.892472] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.892472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.892472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.892472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.892472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.907983] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: UNINITIALIZED for 2s [ 928.159555] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.159749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.159791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.160136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.160392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.160466] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 already deleted. [ 928.160526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.160712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.160897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.161024] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.243449] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.243694] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.243822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.244122] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.244273] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.244429] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 445ffe86-e4b7-46fb-bd82-bf64827e2fef not found, creating... [ 928.244779] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.244862] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.244977] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.245227] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.245546] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.245649] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.246419] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.246419] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.246419] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.246590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.246738] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 445ffe86-e4b7-46fb-bd82-bf64827e2fef is going to be created. [ 928.284997] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.285284] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.285349] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.285814] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.285814] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.286095] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.422089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 928.422633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.423855] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: SUCCESS [ 928.424177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.425019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.425019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.425372] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.425673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.426478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.426478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.426478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.426478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.426478] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.426478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.426732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.426732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.426813] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.426958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.427020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.427134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.427279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.427279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.427368] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.428435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.428435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.428645] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.428743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.428743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.428880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.428933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.429103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.429248] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.546477] env[65446]: INFO networking_nsxv3.common.synchronization [None req-64f8ce59-5532-45b3-b104-247d13501602 None None] Enqueued Resource ID: 7b605051-a147-453e-af31-d4614f85cee7 with Priority: HIGHEST for action port [ 928.546477] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b605051-a147-453e-af31-d4614f85cee7 with Priority: HIGHEST for action port [ 928.546477] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b605051-a147-453e-af31-d4614f85cee7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.546477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b605051-a147-453e-af31-d4614f85cee7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.546477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b605051-a147-453e-af31-d4614f85cee7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.547430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b605051-a147-453e-af31-d4614f85cee7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.547521] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b605051-a147-453e-af31-d4614f85cee7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.681911] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.682074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.682166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.682384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.682471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.682565] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 already deleted. [ 928.682647] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.931548] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d360f67e-96d2-41e3-87bd-00f87fb4fd70: rpc.has_security_group_logging(os_id): False [ 928.935013] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.954019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.954019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.954019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.954019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.954517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.954517] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.954583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.954653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.954872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.955015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.955141] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 928.983023] env[65446]: INFO networking_nsxv3.common.synchronization [req-0daeaba5-f89c-45e2-9266-9534f6138f54 req-1352eda2-57fe-44ce-bfb2-838f4d4002cf service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 928.983023] env[65446]: INFO networking_nsxv3.common.synchronization [req-0daeaba5-f89c-45e2-9266-9534f6138f54 req-1352eda2-57fe-44ce-bfb2-838f4d4002cf service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 928.983023] env[65446]: INFO networking_nsxv3.common.synchronization [req-0daeaba5-f89c-45e2-9266-9534f6138f54 req-1352eda2-57fe-44ce-bfb2-838f4d4002cf service nova] Enqueued Resource ID: 445ffe86-e4b7-46fb-bd82-bf64827e2fef with Priority: HIGHEST for action port [ 928.983958] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 928.984253] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 928.984553] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 445ffe86-e4b7-46fb-bd82-bf64827e2fef with Priority: HIGHEST for action port [ 928.985279] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.985647] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.985847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.986220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.986432] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.988326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.988557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.990021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-445ffe86-e4b7-46fb-bd82-bf64827e2fef taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.990542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.990542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.990542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.991129] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('445ffe86-e4b7-46fb-bd82-bf64827e2fef',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.033984] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.035077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.035077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.035077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.035077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.052185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 929.052185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b605051-a147-453e-af31-d4614f85cee7 [ 929.052185] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.052405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.052405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.052742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.052742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.052882] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b605051-a147-453e-af31-d4614f85cee7 already deleted. [ 929.052970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b605051-a147-453e-af31-d4614f85cee7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.396055] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 in Status: SUCCESS [ 929.396264] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 deletion is rescheduled due to dependency. [ 929.396378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.397179] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea407653-fe6d-49fc-ae9f-5964f5403512 in Status: SUCCESS [ 929.397327] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 deletion is rescheduled due to dependency. [ 929.397433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.435357] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ae8301c-ec7c-4370-9c48-81411fb3a144: rpc.has_security_group_logging(os_id): False [ 929.453201] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.453350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.453419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.453637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.453728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.454568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.454733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.454825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.455044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.455136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.455229] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be updated. [ 929.492830] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.492911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.493138] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 445ffe86-e4b7-46fb-bd82-bf64827e2fef with status ACTIVE [ 929.493319] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.493429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.493495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.493701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.493789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.493963] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.494075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.494146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.494356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.494421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.494679] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.494780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.494914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.495077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.495155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.495240] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 445ffe86-e4b7-46fb-bd82-bf64827e2fef is going to be updated. [ 929.515401] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.515554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.515624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.515846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.515992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.519865] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.519975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.519975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.520180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.520391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.520511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-445ffe86-e4b7-46fb-bd82-bf64827e2fef" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.535721] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: IN_PROGRESS for 2s [ 929.636641] env[65446]: INFO networking_nsxv3.common.synchronization [req-dbeb7926-1752-4467-941e-74b7b8ba4be3 req-139cefc5-ffd0-4d38-ad4a-72d0f2211b65 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 929.637476] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 929.638360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.638360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.638360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.638519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.638770] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.638827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.638886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.639110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.639363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.639363] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.850131] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 929.850313] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 deletion is rescheduled due to dependency. [ 929.850429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.850585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.850799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.850984] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.851113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.851257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.851329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.851410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.851507] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.924809] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 929.925081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.925282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.925529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.925720] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.925830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.925903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.926221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.926221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.926221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.926395] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.023752] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.023752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.023752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.023752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.023752] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.023752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.023752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.023752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.023752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.023752] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.023752] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.023752] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.023752] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.024717] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.024717] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.024717] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.046848] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.047079] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.047236] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.047427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.047781] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-8788a89f-dec2-4a18-9f55-86eb26f848fc taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.047995] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.048141] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.048663] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.048663] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8788a89f-dec2-4a18-9f55-86eb26f848fc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.142192] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.355034] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.431017] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.431188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.431259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.431480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.431652] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.431751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.431814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.431957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.432055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.432144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.432293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.432386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.432448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.432592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.432723] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.432812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.432870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.433010] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.433097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.433176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.433267] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.552456] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.552637] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.552729] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.553035] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.553298] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.553480] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 8788a89f-dec2-4a18-9f55-86eb26f848fc not found, creating... [ 930.553852] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.554014] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.554014] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.554225] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.554554] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.554877] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.555075] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.555562] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.555818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.555963] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.556125] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 8788a89f-dec2-4a18-9f55-86eb26f848fc is going to be created. [ 930.585192] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.585462] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.585542] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.585821] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.586114] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.586366] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.644997] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.863171] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.937138] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a035b80c-7bce-4315-917c-4962056ba63f: rpc.has_security_group_logging(os_id): False [ 930.958657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.959056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.959056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.959264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.959386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.959696] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.959835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.959923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.960311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.960311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.960583] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.960660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.960726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.960908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.961023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.961270] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.961401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.961464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.961657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.961718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.961787] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be created. [ 931.029404] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.029703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.029703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.029838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.030036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.044592] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 931.071795] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 931.072059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.072571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.072571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.072668] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.147893] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.148294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.148294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.148574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.148574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.148705] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 931.179744] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.179915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.180022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.180298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.180495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.191191] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 931.347842] env[65446]: INFO networking_nsxv3.common.synchronization [req-dbeb7926-1752-4467-941e-74b7b8ba4be3 req-cf459d2e-8b16-4666-adc0-0c302c723eae service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 931.348349] env[65446]: INFO networking_nsxv3.common.synchronization [req-dbeb7926-1752-4467-941e-74b7b8ba4be3 req-cf459d2e-8b16-4666-adc0-0c302c723eae service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 931.348349] env[65446]: INFO networking_nsxv3.common.synchronization [req-dbeb7926-1752-4467-941e-74b7b8ba4be3 req-cf459d2e-8b16-4666-adc0-0c302c723eae service nova] Enqueued Resource ID: 8788a89f-dec2-4a18-9f55-86eb26f848fc with Priority: HIGHEST for action port [ 931.348632] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 931.348769] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 931.348865] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8788a89f-dec2-4a18-9f55-86eb26f848fc with Priority: HIGHEST for action port [ 931.350326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.350326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.350326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.350326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.350515] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.351438] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.351573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.351801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8788a89f-dec2-4a18-9f55-86eb26f848fc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.351940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.352042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.352257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.352537] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8788a89f-dec2-4a18-9f55-86eb26f848fc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.365342] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.365617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.365617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.367116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.367116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.367116] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 931.398412] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.398412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.398412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.398759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.398814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.408144] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 931.550728] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: SUCCESS [ 931.550956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.576645] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.576831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.576873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.577261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.577438] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.577502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.577551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.577699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.577809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.577960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.578054] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.855327] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.855327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.858050] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8788a89f-dec2-4a18-9f55-86eb26f848fc with status ACTIVE [ 931.858050] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.858050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.858050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.858050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.858050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.858050] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.858050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.858050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.858050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.858654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.858654] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.858654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.858654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.858773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.858773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.858825] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8788a89f-dec2-4a18-9f55-86eb26f848fc is going to be updated. [ 931.888772] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.889037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.889037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.889221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.889367] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.889547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8788a89f-dec2-4a18-9f55-86eb26f848fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.081271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.081739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.081739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.081880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.082159] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.082331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.082460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.082945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.082945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.082945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.083267] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.083846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.083846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.083846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.084070] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.084070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.084196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.084422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.084579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.084664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.084852] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.587540] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d360f67e-96d2-41e3-87bd-00f87fb4fd70: rpc.has_security_group_logging(os_id): False [ 932.612193] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.612389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.612431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.612656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.612746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.612981] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.613154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.613526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.613526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.613624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.613884] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.614055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.614168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.614400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.614535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.614785] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.615018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.615108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.615258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.615340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.615457] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 932.683801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.683801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.684055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.684143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.684223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.710710] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 933.058644] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 933.058871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.205632] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 933.205632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.205632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.205632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.205632] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.205632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.205632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.205632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.205632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.205632] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.422754] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 933.423149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.423353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.423655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.423912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.424038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.424112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.424263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.424353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.424434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.424519] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.709435] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.916710] env[65446]: INFO networking_nsxv3.common.synchronization [req-26ffae11-e3ff-47fd-bb4b-da487a0e0523 req-a97e370a-3c76-4227-a2e8-27cac1bc6497 tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 933.917676] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 933.917676] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.917821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.917821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.918009] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.918634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.919825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.919992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.920245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.920347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.920450] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.926577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.926711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.926792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.927061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.927669] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.927669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.927669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.927827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.927827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.927887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.928093] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.928234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.928325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.928515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.928665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.928761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.928822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.929015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.929177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.929319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.929457] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.211546] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.422424] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.422587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.424324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.424324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.424324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.424324] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.424324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.424324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.424324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.424324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.424324] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 934.434488] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857e4e4f-84a2-43c7-870d-f3776015cb13: rpc.has_security_group_logging(os_id): False [ 934.452582] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.452741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.452777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.453030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.453116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.453309] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.453407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.453470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.453616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.453693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.453887] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.453981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.454057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.454198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.454272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.454463] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.454555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.454614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.454751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.454827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.454908] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 934.469817] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.469969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.470058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.470274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.470418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.479637] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 934.531614] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.531704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.531745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.532050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.532126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.553607] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 934.715027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.715027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.715027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.715027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.715027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.715027] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 934.745612] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 934.745865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.754107] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.754296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.754373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.754592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.754732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.767745] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 934.920225] env[65446]: INFO networking_nsxv3.common.synchronization [None req-957874f8-d213-4e54-93ac-208851fdaefd None None] Enqueued Resource ID: d435d0eb-a0cd-4f42-ab44-3be28b2c03a5 with Priority: HIGHEST for action port [ 934.921059] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435d0eb-a0cd-4f42-ab44-3be28b2c03a5 with Priority: HIGHEST for action port [ 934.921312] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d435d0eb-a0cd-4f42-ab44-3be28b2c03a5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.921437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d435d0eb-a0cd-4f42-ab44-3be28b2c03a5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.921702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d435d0eb-a0cd-4f42-ab44-3be28b2c03a5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.921987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d435d0eb-a0cd-4f42-ab44-3be28b2c03a5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.922080] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d435d0eb-a0cd-4f42-ab44-3be28b2c03a5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.425607] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d435d0eb-a0cd-4f42-ab44-3be28b2c03a5 [ 935.425970] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.425970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.426097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.426282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.427912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.428094] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d435d0eb-a0cd-4f42-ab44-3be28b2c03a5 already deleted. [ 935.428233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d435d0eb-a0cd-4f42-ab44-3be28b2c03a5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.493655] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 936.493655] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 936.493655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.574975] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 936.575926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.785455] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 936.785792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.785934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.786223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.786513] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.786809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.786809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.786916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.787050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.787465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.787465] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.995998] env[65446]: INFO networking_nsxv3.common.synchronization [None req-5fc9687b-d839-47e6-b5ea-ce46000233cf None None] Enqueued Resource ID: fc070214-f897-456e-ac24-2b36e959b5c3 with Priority: HIGHEST for action port [ 936.998041] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc070214-f897-456e-ac24-2b36e959b5c3 with Priority: HIGHEST for action port [ 936.999565] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc070214-f897-456e-ac24-2b36e959b5c3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.999565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc070214-f897-456e-ac24-2b36e959b5c3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.999565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc070214-f897-456e-ac24-2b36e959b5c3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.999565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc070214-f897-456e-ac24-2b36e959b5c3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.999565] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc070214-f897-456e-ac24-2b36e959b5c3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.291507] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.291723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.291723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.291877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.292702] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.292702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.292702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.292702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.292702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.292702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.292702] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.293327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.293327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.293327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.293327] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.293327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.293327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.293602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.293602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.293602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.293731] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.503343] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc070214-f897-456e-ac24-2b36e959b5c3 [ 937.503604] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.503732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.503800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.504051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.504145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.504267] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc070214-f897-456e-ac24-2b36e959b5c3 already deleted. [ 937.504431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc070214-f897-456e-ac24-2b36e959b5c3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.797517] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 937.819221] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.819425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.819481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.819746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.819746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.819973] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.820130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.820254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.820370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.820450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.820724] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.820836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.820902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.821069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.821146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.821328] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.821427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.821482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.821621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.822176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.822176] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 937.909302] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.909534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.909669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.909948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.910242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.932689] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 937.962121] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e296d10c-7699-438d-b576-4b27a5db0ae8 tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 937.962261] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 937.962872] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.962872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.962872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.963221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.963341] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.082154] env[65446]: INFO networking_nsxv3.common.synchronization [None req-a83a7441-ab67-410a-887a-29057752540d tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 938.082879] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 938.083235] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.083357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.489437] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.489673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.489709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.490424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.490424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.490424] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 already deleted. [ 938.492389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.492389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.492389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.492389] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.016798] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.017201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.017201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.017423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.017641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.017641] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 already deleted. [ 939.017747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.175932] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7e9a3d0b-b5d9-47a1-8ffb-a7d2e051688b None None] Enqueued Resource ID: 52a15d86-b7c6-40eb-9370-a46c29ab620f with Priority: HIGHEST for action port [ 939.176692] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a15d86-b7c6-40eb-9370-a46c29ab620f with Priority: HIGHEST for action port [ 939.177605] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-52a15d86-b7c6-40eb-9370-a46c29ab620f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.177803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52a15d86-b7c6-40eb-9370-a46c29ab620f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.177803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52a15d86-b7c6-40eb-9370-a46c29ab620f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.178160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52a15d86-b7c6-40eb-9370-a46c29ab620f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.178516] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52a15d86-b7c6-40eb-9370-a46c29ab620f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.302202] env[65446]: INFO networking_nsxv3.common.synchronization [req-19ccc2e1-8162-4b0f-8235-7d925e069ad2 req-72696585-5ebb-4b39-9917-1c53cb8f3425 tempest-ServerRescueTestJSON-779930602 tempest-ServerRescueTestJSON-779930602-project-member] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 939.302202] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGHEST for action security_group_members [ 939.302491] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.302736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.302888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.303248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.303553] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.303833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.304013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.304264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.304444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.304680] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.440395] env[65446]: INFO networking_nsxv3.common.synchronization [None req-6c3a194a-1b9a-4afe-8391-ee0df2889866 None None] Enqueued Resource ID: 31e08b77-0484-4968-bf17-afe399d4fcdd with Priority: HIGHEST for action port [ 939.440395] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31e08b77-0484-4968-bf17-afe399d4fcdd with Priority: HIGHEST for action port [ 939.440395] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-31e08b77-0484-4968-bf17-afe399d4fcdd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.440616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31e08b77-0484-4968-bf17-afe399d4fcdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.440616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31e08b77-0484-4968-bf17-afe399d4fcdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.440786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31e08b77-0484-4968-bf17-afe399d4fcdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.440889] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31e08b77-0484-4968-bf17-afe399d4fcdd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.683566] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52a15d86-b7c6-40eb-9370-a46c29ab620f [ 939.684470] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.684470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.684470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.684470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.684470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.684470] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52a15d86-b7c6-40eb-9370-a46c29ab620f already deleted. [ 939.684470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52a15d86-b7c6-40eb-9370-a46c29ab620f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.807735] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.807946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.808121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.808296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.808347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.808555] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.809187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.809187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.809187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.809187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.809187] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be updated. [ 939.843044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.843216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.843289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.843671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.843736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.854806] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: IN_PROGRESS for 2s [ 939.945350] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31e08b77-0484-4968-bf17-afe399d4fcdd [ 939.945350] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.945350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.945350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.945350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.945350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.945350] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31e08b77-0484-4968-bf17-afe399d4fcdd already deleted. [ 939.945350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31e08b77-0484-4968-bf17-afe399d4fcdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.949155] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 939.949372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.504631] env[65446]: INFO networking_nsxv3.common.synchronization [req-e1c17f76-a398-4933-a4c1-c4987e254370 req-adff1b13-343f-4e3a-a52d-a10164d9b298 tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 941.505227] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 941.505539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.505671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.505742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.505917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.506082] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.506182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.506243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.506561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.506561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.506561] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.865202] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 in Status: SUCCESS [ 941.865454] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 deletion is rescheduled due to dependency. [ 941.865535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.009238] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.040759] env[65446]: INFO networking_nsxv3.common.synchronization [req-4d562265-3953-44a8-bff5-6076587ecc89 req-27aa19fe-681f-4142-aace-856132208446 tempest-ImagesNegativeTestJSON-1313262932 tempest-ImagesNegativeTestJSON-1313262932-project-member] Enqueued Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_members [ 942.041363] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_members [ 942.041819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.041819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.041819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.042208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.042396] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.042503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.042556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.042725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.042809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.042936] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.438946] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.439651] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-891" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.439651] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-891" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.439651] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-891" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.440081] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.440152] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.440230] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.440505] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.440572] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.440786] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.440916] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.441050] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.441166] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.441274] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.441380] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.441512] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.462928] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.463188] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.463337] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.463527] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-891" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.463946] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.464153] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.464285] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.464594] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.464735] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b3b5dc-f057-4608-8a4c-b2fd8b24c68f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.510672] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.545569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.545697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.545759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.545972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.546067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.546304] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.546407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.546468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.546641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.546689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.546774] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 already deleted. [ 942.546856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.967565] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.967880] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.968071] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.968448] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.968650] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.968859] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 95b3b5dc-f057-4608-8a4c-b2fd8b24c68f not found, creating... [ 942.969325] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.969553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.969716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.970031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.970216] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.970644] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.970856] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.971024] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.971299] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.971484] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.971670] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 95b3b5dc-f057-4608-8a4c-b2fd8b24c68f is going to be created. [ 942.994045] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.995198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.995198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.995198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.995198] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.995586] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.013220] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.013220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.013220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.013561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.013561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.013705] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 943.071908] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.072140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.072241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.072571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.072749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.087341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 943.731354] env[65446]: INFO networking_nsxv3.common.synchronization [req-4d562265-3953-44a8-bff5-6076587ecc89 req-9606f9d8-aa54-4143-91a3-15656c09a13d service nova] Enqueued Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_rules [ 943.731678] env[65446]: INFO networking_nsxv3.common.synchronization [req-4d562265-3953-44a8-bff5-6076587ecc89 req-9606f9d8-aa54-4143-91a3-15656c09a13d service nova] Enqueued Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_members [ 943.731836] env[65446]: INFO networking_nsxv3.common.synchronization [req-4d562265-3953-44a8-bff5-6076587ecc89 req-9606f9d8-aa54-4143-91a3-15656c09a13d service nova] Enqueued Resource ID: 95b3b5dc-f057-4608-8a4c-b2fd8b24c68f with Priority: HIGHEST for action port [ 943.732566] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_rules [ 943.732788] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_members [ 943.732958] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b3b5dc-f057-4608-8a4c-b2fd8b24c68f with Priority: HIGHEST for action port [ 943.733340] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.733523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.733684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.734064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.734162] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.735519] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.735519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.735519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.735752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.736042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.736115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.736193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.737144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.737144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.737144] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.737975] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.738231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.738345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.738509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.738616] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b3b5dc-f057-4608-8a4c-b2fd8b24c68f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.240653] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.241255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.241255] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.242201] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95b3b5dc-f057-4608-8a4c-b2fd8b24c68f with status ACTIVE [ 944.242987] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.242987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.242987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.243183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.243759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.243759] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.243759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.243943] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.244130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.244407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.244570] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.244727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.245614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.245614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.245614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.245614] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95b3b5dc-f057-4608-8a4c-b2fd8b24c68f is going to be updated. [ 944.277151] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.277312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.277384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.277599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.277743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.277911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b3b5dc-f057-4608-8a4c-b2fd8b24c68f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.491547] env[65446]: INFO networking_nsxv3.common.synchronization [req-bb8e29db-d7af-471b-b66d-3e3c4b6325f2 req-a9ed8a34-2a51-41fc-84a7-a17db7cbd1a5 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 944.492234] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 944.492546] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.492714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.492811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.493059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.493254] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.493624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.493624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.493624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.493742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.493859] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.566028] env[65446]: INFO networking_nsxv3.common.synchronization [req-b4b2bad0-0689-4b74-bc52-4acfb81cef80 req-d11e0a5e-1c6a-4055-a065-698e53966311 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 944.567103] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 944.567103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.567103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.567103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.567393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.567616] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.567765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.567867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.568075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.568208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.568338] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.752024] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.877065] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.877065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.877065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.877065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.877065] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.877065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.877065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.877065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.877065] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.877539] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.877539] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.877539] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.877539] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.877667] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.877710] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.877840] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.896370] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.896541] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.896680] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.896850] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-723" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.897215] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-8d306986-f873-4f53-b10c-3642ebcdb697 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.897393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.897514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.897845] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.897979] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d306986-f873-4f53-b10c-3642ebcdb697',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.996203] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.071261] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.101482] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 945.102127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.251568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.251739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.251795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.252027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.252119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.252218] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 is going to be created. [ 945.279035] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.279262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.279262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.279425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.279585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.289524] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 in Status: UNINITIALIZED for 2s [ 945.400818] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.400818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.400818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.400818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.400818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.401112] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 8d306986-f873-4f53-b10c-3642ebcdb697 not found, creating... [ 945.401262] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.401495] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.401657] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.401889] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.402053] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.402379] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.402568] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.402712] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.402947] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.403114] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.403281] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 8d306986-f873-4f53-b10c-3642ebcdb697 is going to be created. [ 945.425637] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.425883] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.426076] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.426381] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.426630] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.426872] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.499083] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.573726] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.001509] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.001910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.001910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.001980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.002078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.002199] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 946.040949] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.041635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.041635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.041635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.041635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.053153] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 946.075826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.076032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.076082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.076389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.076471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.076520] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 946.112874] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.113080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.113120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.113342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.113489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.125455] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 946.190304] env[65446]: INFO networking_nsxv3.common.synchronization [req-b4b2bad0-0689-4b74-bc52-4acfb81cef80 req-9315d65c-a284-4af5-bd4b-53010c8abc59 service nova] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 946.190485] env[65446]: INFO networking_nsxv3.common.synchronization [req-b4b2bad0-0689-4b74-bc52-4acfb81cef80 req-9315d65c-a284-4af5-bd4b-53010c8abc59 service nova] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 946.190624] env[65446]: INFO networking_nsxv3.common.synchronization [req-b4b2bad0-0689-4b74-bc52-4acfb81cef80 req-9315d65c-a284-4af5-bd4b-53010c8abc59 service nova] Enqueued Resource ID: 8d306986-f873-4f53-b10c-3642ebcdb697 with Priority: HIGHEST for action port [ 946.191541] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 946.191541] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 946.191541] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d306986-f873-4f53-b10c-3642ebcdb697 with Priority: HIGHEST for action port [ 946.191651] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.191798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.191862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.192047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.192150] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.192985] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.193136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.193355] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d306986-f873-4f53-b10c-3642ebcdb697 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.193464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.193520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.193715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.194619] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d306986-f873-4f53-b10c-3642ebcdb697',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.696050] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.696259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.696646] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d306986-f873-4f53-b10c-3642ebcdb697 with status ACTIVE [ 946.696814] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.697084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.697084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.697357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.697533] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.697795] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.697968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.698842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.698842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.698842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.698842] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.698842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.698842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.699425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.699425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.699425] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d306986-f873-4f53-b10c-3642ebcdb697 is going to be updated. [ 946.723553] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.723804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.723884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.724126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.724329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.724547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.314245] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 in Status: SUCCESS [ 947.314735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.314735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.314918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.315166] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.315302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.315544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.315599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.315659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.315755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.315861] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.818245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.818429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.818494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.818721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.818889] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.818991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.819093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.819279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.819379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.819472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.819620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.819715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.819775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.819913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.820544] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.820654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.820718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.820863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.820940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.827035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.827035] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.064704] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 948.064964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.136566] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 948.138016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.138016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.138016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.138016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.138016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.138016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.138420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.138420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.138420] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.326943] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e2374b8-374d-4226-b090-9ede1d4ec196: rpc.has_security_group_logging(os_id): False [ 948.346097] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.346097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.346097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.346446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.346446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.346733] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.346881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.346975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.347307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.347443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.347701] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.347832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.347920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.348153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.348229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.348543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.348640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.348694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.348842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.348920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.349038] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 is going to be created. [ 948.416894] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.417167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.417264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.417519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.417774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.430528] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 in Status: IN_PROGRESS for 2s [ 948.641535] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.144955] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.647609] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.647959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.647959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.648414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.648520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.648714] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 949.681461] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.681650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.681689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.681981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.682175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.690745] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 950.445736] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 in Status: SUCCESS [ 950.447216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.980143] env[65446]: INFO networking_nsxv3.common.synchronization [req-72863dcd-ae44-4f8c-942f-2224c79b5cc2 req-39a540f3-591f-4c5d-b090-a3050227aed2 tempest-ServersTestJSON-1390728580 tempest-ServersTestJSON-1390728580-project-member] Enqueued Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_members [ 950.980143] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_members [ 950.980143] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.980143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.980143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.980143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.980143] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.980143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.980143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.980793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.980793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.980793] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.376242] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.376500] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-605" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.376673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-605" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.377244] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-605" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.377770] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.377770] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.377894] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.378269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.378493] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.378890] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.378951] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.379058] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.379360] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.379360] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.379503] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.379806] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.404325] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.404588] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.404699] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.404883] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-605" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.405353] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-fa2d779d-2b2a-4a26-b154-9967f4edabdd taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.405542] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.405680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.406031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.406211] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa2d779d-2b2a-4a26-b154-9967f4edabdd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.482763] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.482995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.482995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.483230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.483321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.483522] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.483614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.483674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.483822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.483899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.483985] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 already deleted. [ 951.484085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.703144] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 951.703556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.703740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.703962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.704180] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.704302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.704365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.704520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.704601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.704686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.704779] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.908822] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.909093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.909158] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.909473] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.909691] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.909892] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port fa2d779d-2b2a-4a26-b154-9967f4edabdd not found, creating... [ 951.910235] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.910429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.910558] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.910800] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.910945] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.911265] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.911424] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.911541] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.911758] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.911898] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.912052] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: fa2d779d-2b2a-4a26-b154-9967f4edabdd is going to be created. [ 951.933302] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.933525] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.933655] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.933993] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.934246] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.934503] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.207686] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.208089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.208089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.208623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.208789] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.209625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.209625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.209789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.209892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.209991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.210180] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.210309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.211026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.211026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.211026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.211026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.211026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.211026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.211281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.211281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.211281] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.640882] env[65446]: INFO networking_nsxv3.common.synchronization [req-72863dcd-ae44-4f8c-942f-2224c79b5cc2 req-2b915384-c7fa-4a55-9172-bf8bb1258d89 service nova] Enqueued Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_rules [ 952.641161] env[65446]: INFO networking_nsxv3.common.synchronization [req-72863dcd-ae44-4f8c-942f-2224c79b5cc2 req-2b915384-c7fa-4a55-9172-bf8bb1258d89 service nova] Enqueued Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_members [ 952.641377] env[65446]: INFO networking_nsxv3.common.synchronization [req-72863dcd-ae44-4f8c-942f-2224c79b5cc2 req-2b915384-c7fa-4a55-9172-bf8bb1258d89 service nova] Enqueued Resource ID: fa2d779d-2b2a-4a26-b154-9967f4edabdd with Priority: HIGHEST for action port [ 952.642655] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_rules [ 952.643336] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_members [ 952.643336] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2d779d-2b2a-4a26-b154-9967f4edabdd with Priority: HIGHEST for action port [ 952.643521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.643608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.643705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.643990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.644717] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.646671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.646845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.647108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.647606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.647827] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.647981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.648300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.649822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.649822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.649822] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.650784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa2d779d-2b2a-4a26-b154-9967f4edabdd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.650983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.651058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.651752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.651752] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa2d779d-2b2a-4a26-b154-9967f4edabdd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.713663] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d360f67e-96d2-41e3-87bd-00f87fb4fd70: rpc.has_security_group_logging(os_id): False [ 952.734688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.734848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.734921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.735212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.735317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.735613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.735715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.735775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.735959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.736034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.736267] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.736562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.736562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.736719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.736719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.736917] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.737018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.737115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.737265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.737322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.737413] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 952.802282] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.802471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.802542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.802775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.802853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.821814] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 953.147093] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.147242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.151921] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.154621] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa2d779d-2b2a-4a26-b154-9967f4edabdd with status ACTIVE [ 953.154903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.155084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.155587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.155587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.155587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.155765] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.155765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.155863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.156040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.156091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.156377] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.156456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.156518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.156712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.156712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.156818] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa2d779d-2b2a-4a26-b154-9967f4edabdd is going to be updated. [ 953.177994] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.177994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.177994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.178609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.178609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.178609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa2d779d-2b2a-4a26-b154-9967f4edabdd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.656295] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.158761] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.158919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.159034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.159204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.159285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.159398] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 is going to be created. [ 954.184088] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.184291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.184351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.184544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.185135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.198319] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 in Status: UNINITIALIZED for 2s [ 954.846698] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 954.847182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.457321] env[65446]: INFO networking_nsxv3.common.synchronization [req-f0762fcf-8cad-48a5-b970-42d053a46983 req-425a6b9d-1e2c-4faa-92c9-d75dac229099 tempest-ServerMetadataNegativeTestJSON-764924543 tempest-ServerMetadataNegativeTestJSON-764924543-project-member] Enqueued Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_members [ 955.457321] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_members [ 955.457321] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.457901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.458144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.458811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.459226] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.460183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.460370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.460978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.461292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.461507] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.537034] env[65446]: INFO networking_nsxv3.common.synchronization [req-1ec9ca49-caca-47ac-a585-598b02cdae2b req-3640654a-34ed-4b32-85b3-9b1321bd237b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 955.537034] env[65446]: INFO networking_nsxv3.common.synchronization [req-1ec9ca49-caca-47ac-a585-598b02cdae2b req-3640654a-34ed-4b32-85b3-9b1321bd237b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 955.537034] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 955.537034] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 955.537585] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.540537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.540537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.540537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.540537] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.540537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.540537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.540537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.540537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.540537] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.542601] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.542601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.542601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.542601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.542601] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.543377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.543377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.543377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.543770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.543770] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.911870] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.912240] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.912575] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.913077] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.913564] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.913844] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.914068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.914682] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.914682] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.914981] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.916262] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.916323] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.916500] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.916700] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.916889] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.917154] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.949809] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.950086] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.950285] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.950507] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.950886] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-e342790b-a1a6-49c8-a309-6544a3e9cb85 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.951131] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.951303] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.951680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.951930] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e342790b-a1a6-49c8-a309-6544a3e9cb85',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.963847] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.964013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.964108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.964323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.964414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.964649] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.964753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.964808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.964961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.965138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.965138] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 already deleted. [ 955.965237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.016404] env[65446]: INFO networking_nsxv3.common.synchronization [req-1ec9ca49-caca-47ac-a585-598b02cdae2b req-3640654a-34ed-4b32-85b3-9b1321bd237b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_rules [ 956.016565] env[65446]: INFO networking_nsxv3.common.synchronization [req-1ec9ca49-caca-47ac-a585-598b02cdae2b req-3640654a-34ed-4b32-85b3-9b1321bd237b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 956.016701] env[65446]: INFO networking_nsxv3.common.synchronization [req-1ec9ca49-caca-47ac-a585-598b02cdae2b req-3640654a-34ed-4b32-85b3-9b1321bd237b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 956.016836] env[65446]: INFO networking_nsxv3.common.synchronization [req-1ec9ca49-caca-47ac-a585-598b02cdae2b req-3640654a-34ed-4b32-85b3-9b1321bd237b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 956.016970] env[65446]: INFO networking_nsxv3.common.synchronization [req-1ec9ca49-caca-47ac-a585-598b02cdae2b req-3640654a-34ed-4b32-85b3-9b1321bd237b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 8d306986-f873-4f53-b10c-3642ebcdb697 with Priority: HIGHEST for action port [ 956.018010] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_rules [ 956.018315] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 956.018411] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d306986-f873-4f53-b10c-3642ebcdb697 with Priority: HIGHEST for action port [ 956.018513] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 956.018634] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 956.018909] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.019050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.019116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.019431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.019505] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.021173] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.021333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.021380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.021586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.021963] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.023651] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d306986-f873-4f53-b10c-3642ebcdb697 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.023651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.023651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.023651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.023857] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d306986-f873-4f53-b10c-3642ebcdb697',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.030347] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.030559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.030923] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.031140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.042540] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.046308] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.208952] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 in Status: SUCCESS [ 956.209473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.209473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.209589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.211046] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.211046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.211046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.211046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.211046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.211046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.211046] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.345876] env[65446]: INFO networking_nsxv3.common.synchronization [req-02971932-d2b5-4070-b87b-743db8452fbd req-440343a0-9c7f-4897-96f4-f84d952ce2b0 tempest-ImagesNegativeTestJSON-1313262932 tempest-ImagesNegativeTestJSON-1313262932-project-member] Enqueued Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_members [ 956.346462] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGHEST for action security_group_members [ 956.346615] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.347239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.347334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.347542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.347709] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.347813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.347880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.348044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.348203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.348303] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.456789] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.457018] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.457210] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.457527] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.457686] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.457855] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port e342790b-a1a6-49c8-a309-6544a3e9cb85 not found, creating... [ 956.458159] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.458340] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.458514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.458700] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.458858] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.459209] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.459863] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.460084] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.460376] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.460942] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.460942] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: e342790b-a1a6-49c8-a309-6544a3e9cb85 is going to be created. [ 956.484545] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.484802] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.484932] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.485245] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.486155] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.486155] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.521643] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.522252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.530782] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d306986-f873-4f53-b10c-3642ebcdb697 with status ACTIVE [ 956.531060] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.531251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.531373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.531586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.531675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.531876] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.531971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.532041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.532194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.532273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.532462] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.532543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.532606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.532743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.532816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.532908] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d306986-f873-4f53-b10c-3642ebcdb697 is going to be updated. [ 956.534558] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.534744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.546821] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.550352] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.567584] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.567786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.567883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.568270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.568615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.568874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.715444] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.852675] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.852675] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.852675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.852675] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 is going to be updated. [ 956.882771] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.882935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.882999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.883206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.883351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.894674] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 in Status: IN_PROGRESS for 2s [ 957.048729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.048995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.048995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.049286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.049407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.049548] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be created. [ 957.053498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.053634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.054186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.054186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.054186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.054186] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 957.082072] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.082072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.082072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.082316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.082589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.088725] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.089019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.091077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.091077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.091077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.100625] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: UNINITIALIZED for 2s [ 957.101578] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 957.194080] env[65446]: INFO networking_nsxv3.common.synchronization [req-f0762fcf-8cad-48a5-b970-42d053a46983 req-5988bcf2-dee7-4ea2-a6c4-83b589360a43 service nova] Enqueued Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_rules [ 957.194330] env[65446]: INFO networking_nsxv3.common.synchronization [req-f0762fcf-8cad-48a5-b970-42d053a46983 req-5988bcf2-dee7-4ea2-a6c4-83b589360a43 service nova] Enqueued Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_members [ 957.194693] env[65446]: INFO networking_nsxv3.common.synchronization [req-f0762fcf-8cad-48a5-b970-42d053a46983 req-5988bcf2-dee7-4ea2-a6c4-83b589360a43 service nova] Enqueued Resource ID: e342790b-a1a6-49c8-a309-6544a3e9cb85 with Priority: HIGHEST for action port [ 957.195299] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_rules [ 957.195465] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_members [ 957.195571] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e342790b-a1a6-49c8-a309-6544a3e9cb85 with Priority: HIGHEST for action port [ 957.195864] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.195991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.196209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.196443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.196531] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.198125] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.198262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.198327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.198503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.198663] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.198761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.198815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.198960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.199059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.199153] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.200953] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-e342790b-a1a6-49c8-a309-6544a3e9cb85 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.200953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.201704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.201924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.202027] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e342790b-a1a6-49c8-a309-6544a3e9cb85',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.217706] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a3d84de-849b-4168-a66d-1a888b3d35e1: rpc.has_security_group_logging(os_id): False [ 957.237486] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.237636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.237673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.237864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.237950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.238284] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.238384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.239102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.239102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.239102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.239102] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 is going to be created. [ 957.346997] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.347266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.347364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.347679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.347969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.363440] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 in Status: IN_PROGRESS for 2s [ 957.699385] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.699385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.701600] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.705122] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e342790b-a1a6-49c8-a309-6544a3e9cb85 with status ACTIVE [ 957.705502] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.705502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.705643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.706027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.706027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.706027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.706182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.706182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.706267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.706314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.706568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.706568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.706687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.706791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.707365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.707365] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e342790b-a1a6-49c8-a309-6544a3e9cb85 is going to be updated. [ 957.733859] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.734110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.734150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.734354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.734494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.734652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e342790b-a1a6-49c8-a309-6544a3e9cb85" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.043019] env[65446]: INFO networking_nsxv3.common.synchronization [req-308f8cd0-83ab-4354-95fc-57d76b77ee3f req-fd21143b-476c-42a3-80d1-be57ac03c720 tempest-ServersNegativeTestJSON-1295958692 tempest-ServersNegativeTestJSON-1295958692-project-member] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 958.043019] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 958.043019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.043019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.043019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.043019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.043456] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.043660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.043801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.044038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.044232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.044422] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.205760] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.392135] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.392387] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.392524] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.392812] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.394183] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.394183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.394183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.394183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.394183] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.394183] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.394472] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.394472] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.394472] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.394582] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.394664] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.394799] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.414340] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.414340] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.414494] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.414606] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.414920] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-5135be2d-2043-4482-a924-5e5eed767851 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.415155] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.415289] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.415680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.415828] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5135be2d-2043-4482-a924-5e5eed767851',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.548981] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.713032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.713032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.713032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.713032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.713032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.713032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 is going to be created. [ 958.737555] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.737555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.737555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.737768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.738567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.747643] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 in Status: UNINITIALIZED for 2s [ 958.904801] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 in Status: SUCCESS [ 958.905010] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 deletion is rescheduled due to dependency. [ 958.905129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.918350] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.918578] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.918709] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.918981] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.919155] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.919373] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 5135be2d-2043-4482-a924-5e5eed767851 not found, creating... [ 958.919807] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.919991] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.920139] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.920371] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.920516] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.920810] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.920970] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.921122] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.921341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.921477] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.921620] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 5135be2d-2043-4482-a924-5e5eed767851 is going to be created. [ 958.942473] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.942721] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.942810] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.943099] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.943438] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.943573] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.051340] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.113358] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: SUCCESS [ 959.113587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.113758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.113978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.114965] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.114965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.114965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.114965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.114965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.114965] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.116283] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 959.116453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.116605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.116773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.117248] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.117248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.117248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.117442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.117442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.117442] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.376111] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 in Status: SUCCESS [ 959.376502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.554514] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.554666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.554742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.554968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.555373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.555550] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 959.589882] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.590067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.590124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.590324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.590469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.599385] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 959.619019] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.621755] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.663219] env[65446]: INFO networking_nsxv3.common.synchronization [req-308f8cd0-83ab-4354-95fc-57d76b77ee3f req-94448af5-9d06-40dc-bff4-b7a9c4c12a63 service nova] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_rules [ 959.663219] env[65446]: INFO networking_nsxv3.common.synchronization [req-308f8cd0-83ab-4354-95fc-57d76b77ee3f req-94448af5-9d06-40dc-bff4-b7a9c4c12a63 service nova] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 959.663219] env[65446]: INFO networking_nsxv3.common.synchronization [req-308f8cd0-83ab-4354-95fc-57d76b77ee3f req-94448af5-9d06-40dc-bff4-b7a9c4c12a63 service nova] Enqueued Resource ID: 5135be2d-2043-4482-a924-5e5eed767851 with Priority: HIGHEST for action port [ 959.663485] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_rules [ 959.663485] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 959.663577] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5135be2d-2043-4482-a924-5e5eed767851 with Priority: HIGHEST for action port [ 959.664201] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.664201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.664488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.664684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.664813] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.665656] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.665752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.665944] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5135be2d-2043-4482-a924-5e5eed767851 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.666076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.666110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.666288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.666383] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5135be2d-2043-4482-a924-5e5eed767851',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.122413] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.125344] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.168898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.168898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.171299] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5135be2d-2043-4482-a924-5e5eed767851 with status ACTIVE [ 960.171513] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.171642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.171717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.171934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.172037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.172215] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.172335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.172377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.172505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.172584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.173688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.173688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.173688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.173688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.173688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.173688] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5135be2d-2043-4482-a924-5e5eed767851 is going to be updated. [ 960.194866] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.195128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.195243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.196030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.196030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.196030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5135be2d-2043-4482-a924-5e5eed767851" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.509647] env[65446]: INFO networking_nsxv3.common.synchronization [req-c437c9c0-7291-4cca-9a75-7c6fb1196909 req-fbc6032d-5f87-41ce-aed5-b4d18a14b6c1 tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 960.510200] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 960.510835] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.511014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.511135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.511487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.511733] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.511885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.511990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.512410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.512410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.512637] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.624780] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.624971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.625049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.625249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.625339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.625436] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be updated. [ 960.626824] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.626934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.626934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.627169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.627259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.628024] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 960.657497] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.657680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.657680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.657973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.658060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.660030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.660334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.660427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.660608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.660731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.671500] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 960.672244] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: IN_PROGRESS for 2s [ 960.757711] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 in Status: SUCCESS [ 960.757942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.758243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.758461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.758665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.758789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.758890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.759095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.759187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.759325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.759433] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.840229] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.840482] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.840547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.840872] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.841603] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.841781] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.841902] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.842140] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.842287] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.842498] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.842610] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.842724] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.842834] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.842972] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.843110] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.843558] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.866227] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.866227] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 960.866518] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.866518] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.866865] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-98c54d0c-b7d9-4350-970d-da791f655f9a taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.867072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.867227] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.867548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.867685] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c54d0c-b7d9-4350-970d-da791f655f9a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.015266] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.015464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.015522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.015744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.015837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.016061] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.016191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.016247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.016397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.016475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.016562] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 already deleted. [ 961.016642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.261679] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.262026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.262026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.262164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.262791] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.262791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.262791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.262791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.262791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.262791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.263112] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.263112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.263112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.263227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.263365] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.263478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.263521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.263638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.263708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.263785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.263870] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.369824] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.370089] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.370205] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.370478] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.370627] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.370782] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 98c54d0c-b7d9-4350-970d-da791f655f9a not found, creating... [ 961.371039] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.371199] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.371328] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.371555] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.371687] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.371960] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.372142] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.372274] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.372477] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.372610] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.372752] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 98c54d0c-b7d9-4350-970d-da791f655f9a is going to be created. [ 961.393334] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.393549] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.393683] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.393959] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.394232] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.394477] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.610288] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 961.610697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.611377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.611377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.611577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.611660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.611702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.611952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.612081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.612197] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.766466] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8: rpc.has_security_group_logging(os_id): False [ 961.801971] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.802153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.802218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.802393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.802484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.802712] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.802784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.802850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.803008] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.803103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.803294] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.803394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.803476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.803596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.803669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.803842] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.803952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.803998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.804338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.804338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.804338] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 is going to be created. [ 961.876605] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.876791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.876791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.876983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.877250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.893362] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 in Status: IN_PROGRESS for 2s [ 962.114423] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.133610] env[65446]: INFO networking_nsxv3.common.synchronization [req-c437c9c0-7291-4cca-9a75-7c6fb1196909 req-93d131f0-cc98-4eaf-909c-464bccfa2a0b service nova] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 962.134101] env[65446]: INFO networking_nsxv3.common.synchronization [req-c437c9c0-7291-4cca-9a75-7c6fb1196909 req-93d131f0-cc98-4eaf-909c-464bccfa2a0b service nova] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 962.134101] env[65446]: INFO networking_nsxv3.common.synchronization [req-c437c9c0-7291-4cca-9a75-7c6fb1196909 req-93d131f0-cc98-4eaf-909c-464bccfa2a0b service nova] Enqueued Resource ID: 98c54d0c-b7d9-4350-970d-da791f655f9a with Priority: HIGHEST for action port [ 962.135148] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 962.135384] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 962.135384] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c54d0c-b7d9-4350-970d-da791f655f9a with Priority: HIGHEST for action port [ 962.135668] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.135773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.135837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.136251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.136251] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.137162] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.137225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.137258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.137423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.137617] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.137743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.137807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.137967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.138125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.138185] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.139160] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c54d0c-b7d9-4350-970d-da791f655f9a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.139160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.139160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.139735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.139735] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c54d0c-b7d9-4350-970d-da791f655f9a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.619871] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.643032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.643264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.643370] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.644289] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98c54d0c-b7d9-4350-970d-da791f655f9a with status ACTIVE [ 962.644505] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.644659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.644732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.644967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.645092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.645296] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.645398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.651187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.651187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.651187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.651187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.651187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.651187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.651416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.651416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.651475] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98c54d0c-b7d9-4350-970d-da791f655f9a is going to be updated. [ 962.686397] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.686713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.686859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.687210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.687473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.687753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c54d0c-b7d9-4350-970d-da791f655f9a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.688941] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 962.689629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.689629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.689794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.690116] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.690335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.690471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.690743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.690931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.691488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.691705] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.696799] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: SUCCESS [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.696799] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.696799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.696799] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.122101] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.122334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.122423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.122695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.122814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.122954] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 963.153619] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.153805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.153846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.154065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.154251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.155365] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.167841] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 963.199666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.199666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.199848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.200925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.200925] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.200925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.200925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.200925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.200925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.200925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.201281] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.201281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.201281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.201281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.201953] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.201953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.201953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.201953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.201953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.201953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.201953] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.203281] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.662297] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.662771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.662771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.662838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.662881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.662980] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be created. [ 963.691822] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.691988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.692236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.692312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.692413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.704498] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: UNINITIALIZED for 2s [ 963.707012] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052: rpc.has_security_group_logging(os_id): False [ 963.708295] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d360f67e-96d2-41e3-87bd-00f87fb4fd70: rpc.has_security_group_logging(os_id): False [ 963.733332] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.733484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.733542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.733759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.733852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.734103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.734224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.734279] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.734506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.734600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.734719] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be created. [ 963.736690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.736811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.736853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.737017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.737137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.737525] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.737613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.737677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.737842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.737985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.738229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.738393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.738457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.738627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.738709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.738938] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.739038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.739090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.739215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.739295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.739380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 963.812422] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.812587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.813035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.813035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.813288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.829979] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: IN_PROGRESS for 2s [ 963.831340] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.831474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.832475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.832475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.832475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.858237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 963.930063] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 in Status: SUCCESS [ 963.931508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.950643] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 963.950693] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_members [ 963.950850] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 963.951748] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 963.952107] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_members [ 963.952305] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 963.952782] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.953079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.953189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.953507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.953835] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.954040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.954183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.954700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.954938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.955105] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.957788] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86ba0be-f9c3-46c0-93b8-48259d0b813b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.957788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.957788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.957788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.957788] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.958085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.958085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.958400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.958400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.958824] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.959696] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.959857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.959952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.960186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.960400] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.960604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.960604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.960819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.960930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.961062] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.012375] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_rules [ 964.012561] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 964.012698] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 964.012823] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 964.012949] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_rules [ 964.013095] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_members [ 964.013227] env[65446]: INFO networking_nsxv3.common.synchronization [req-399c83ee-cdca-4b0c-ba7a-08430c8af031 req-03b120f2-0a09-4082-96a5-7f6e4d4ffcb5 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 8d306986-f873-4f53-b10c-3642ebcdb697 with Priority: HIGHEST for action port [ 964.014395] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_rules [ 964.014526] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_rules [ 964.014654] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_members [ 964.014827] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d306986-f873-4f53-b10c-3642ebcdb697 with Priority: HIGHEST for action port [ 964.014896] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_rules [ 964.015065] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 964.015269] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 964.015897] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.016053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.016342] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.016473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.016701] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86ba0be-f9c3-46c0-93b8-48259d0b813b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.016764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.016949] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d306986-f873-4f53-b10c-3642ebcdb697 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.017062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.017152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.017385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.017473] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d306986-f873-4f53-b10c-3642ebcdb697',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.018337] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e86ba0be-f9c3-46c0-93b8-48259d0b813b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.018434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.018531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.018779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.018913] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.019652] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.019954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.020214] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.020309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.465926] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.466368] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.467379] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.521836] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86ba0be-f9c3-46c0-93b8-48259d0b813b taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.522151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.522151] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d306986-f873-4f53-b10c-3642ebcdb697 with status ACTIVE [ 964.522326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.522405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.522469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.522703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.522806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.523081] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.523254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.523352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.523546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.523631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.523848] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.523924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.523962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.524127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.524186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.524398] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d306986-f873-4f53-b10c-3642ebcdb697 is going to be updated. [ 964.547438] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.547570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.547656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.547891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.547976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.548251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d306986-f873-4f53-b10c-3642ebcdb697" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.970425] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.971403] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.972093] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.180423] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 965.180423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.180631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.180914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.181191] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.181327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.181413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.181687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.181757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.181870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.181992] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.475951] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.475951] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be updated. [ 965.475951] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.475951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.475951] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b is going to be created. [ 965.477749] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.478044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.478249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.478510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.478700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.479049] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 965.509688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.509688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.509688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.509688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.509688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.511985] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.512655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.515023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.515023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.515023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.515600] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.515918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.516116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.518425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.518425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.528397] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b in Status: UNINITIALIZED for 2s [ 965.530647] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: IN_PROGRESS for 2s [ 965.530647] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 965.691957] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.691957] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.691957] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.691957] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.691957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.692592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.692592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.692592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.692592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.692592] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.715875] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 965.715875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.716116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.717025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.717025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.717025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.717025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.717025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.717408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.717544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.717663] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.856680] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: SUCCESS [ 965.856680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.856680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.856680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.856680] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.883516] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 965.884113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.884113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.884572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.884743] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.195504] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a035b80c-7bce-4315-917c-4962056ba63f: rpc.has_security_group_logging(os_id): False [ 966.215078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.215331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.215433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.215676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.215775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.216062] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.216169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.216236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.216399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.217025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.217025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.217025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.217025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.217025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.217025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.217566] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.217566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.217566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.217683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.217683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.217760] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 966.219435] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.316801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.316801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.316801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.316801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.316801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.335881] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 966.350558] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.350779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.388024] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.388259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.696687] env[65446]: INFO networking_nsxv3.common.synchronization [req-54111604-4d50-48fd-9a08-23098e5beb7b req-844f29fb-6077-420e-90a1-d0badbe87b9b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 966.697092] env[65446]: INFO networking_nsxv3.common.synchronization [req-54111604-4d50-48fd-9a08-23098e5beb7b req-844f29fb-6077-420e-90a1-d0badbe87b9b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_members [ 966.697092] env[65446]: INFO networking_nsxv3.common.synchronization [req-54111604-4d50-48fd-9a08-23098e5beb7b req-844f29fb-6077-420e-90a1-d0badbe87b9b tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 966.698042] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGHEST for action security_group_members [ 966.698042] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b with Priority: HIGHEST for action security_group_members [ 966.698042] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 966.698247] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.698317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.698625] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e86ba0be-f9c3-46c0-93b8-48259d0b813b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.698734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.698930] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.699025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.721923] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44: rpc.has_security_group_logging(os_id): False [ 966.744072] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.744072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.744072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.744072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.744296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.744387] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.744474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.744534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.744791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.744896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.744990] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be created. [ 966.816812] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.817017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.817293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.817575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.817822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.830770] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: IN_PROGRESS for 2s [ 967.328335] env[65446]: INFO networking_nsxv3.common.synchronization [req-5247448d-eca8-4029-8a20-75f4cdc752cf req-f2678252-16cc-4f07-ba64-c454741e2a2e tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 967.329207] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 967.329474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.329618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.329682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.329897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.330629] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.330756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.332066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.332066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.332066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.332066] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.544838] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 967.544838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.545130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.545325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.545390] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.545485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.545564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.545722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.545833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.545955] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.547702] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b in Status: SUCCESS [ 967.547889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.548603] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: SUCCESS [ 967.548785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.548947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.549471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.549471] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.549471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.549680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.549680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.549786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.549929] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.550694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.551433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.551433] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.551433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.551433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.551433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.551433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.551908] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.833956] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.053298] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.053526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.053526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.053865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.053991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.054239] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.054387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.054475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.054641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.054738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.054851] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b is going to be deleted. [ 968.055902] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.057645] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.057777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.057835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.057998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.058123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.058327] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.058479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.058559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.058714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.058790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.058877] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be updated. [ 968.093883] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.093883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.093883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.093883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.093883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.106905] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.106905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.106905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.106905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.106905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.106905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.107358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.107358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.107428] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.107552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.107599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.107745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.107820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.107915] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.109572] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: IN_PROGRESS for 2s [ 968.337035] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.359890] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 968.360123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.561320] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.733121] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.733376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.733376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.733575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.733663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.733944] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.734072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.734072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.734183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.734256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.734341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b already deleted. [ 968.734432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.734535] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.735410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.735595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.735750] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.735853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.735982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.736072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.736147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.736234] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.841728] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.841932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.841975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.842206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.842292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.842394] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 968.844048] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 968.844250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.869933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.870101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.870203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.870427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.870570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.880036] env[65446]: INFO networking_nsxv3.common.synchronization [req-b837f643-8b76-488b-8f9c-ef93e36f4a22 req-b78ccc65-b89a-44c4-9c01-ed4726934d43 tempest-ServerMetadataNegativeTestJSON-764924543 tempest-ServerMetadataNegativeTestJSON-764924543-project-member] Enqueued Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_members [ 968.880718] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 968.881157] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGHEST for action security_group_members [ 968.881681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.881803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.881870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.882082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.882263] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.882366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.882427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.882572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.882651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.882752] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.064025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.064256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.064256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.064875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.064875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.064875] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 969.109881] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.110119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.110179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.110399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.110890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.120240] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 969.240249] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e86ba0be-f9c3-46c0-93b8-48259d0b813b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.241480] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.241633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.241697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.241922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.242041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.242204] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.242312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.242364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.242498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.242571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.242655] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b already deleted. [ 969.242726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.384992] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.385305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.385305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.385935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.385935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.385935] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.386134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.386134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.386289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.386289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.386380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 is going to be updated. [ 969.415857] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.415857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.415857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.416079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.416209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.426360] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 in Status: IN_PROGRESS for 2s [ 969.743729] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e86ba0be-f9c3-46c0-93b8-48259d0b813b: rpc.has_security_group_logging(os_id): False [ 969.763908] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.764106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.764106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.764292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.764381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.764618] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.764717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.764778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.764929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.765008] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.765175] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b is going to be created. [ 969.782591] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e86ba0be-f9c3-46c0-93b8-48259d0b813b], does not exist path=[/infra/domains/default/groups/e86ba0be-f9c3-46c0-93b8-48259d0b813b]."\n}' [ 969.782760] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e86ba0be-f9c3-46c0-93b8-48259d0b813b [ 969.782838] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 969.819845] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.819845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.820021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.820116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.821397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.821691] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.821798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.821863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.822033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.822113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.822313] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.822410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.822471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.822616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.822693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.822778] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e86ba0be-f9c3-46c0-93b8-48259d0b813b is going to be created. [ 969.843011] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e86ba0be-f9c3-46c0-93b8-48259d0b813b], does not exist path=[/infra/domains/default/groups/e86ba0be-f9c3-46c0-93b8-48259d0b813b]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e86ba0be-f9c3-46c0-93b8-48259d0b813b [ 969.843195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e86ba0be-f9c3-46c0-93b8-48259d0b813b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.843732] env[65446]: Traceback (most recent call last): [ 969.843779] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 969.843779] env[65446]: return func(*args, **kwargs) [ 969.843779] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 969.843779] env[65446]: res.raise_for_status() [ 969.843779] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 969.843779] env[65446]: raise HTTPError(http_error_msg, response=self) [ 969.843779] env[65446]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e86ba0be-f9c3-46c0-93b8-48259d0b813b [ 969.843779] env[65446]: During handling of the above exception, another exception occurred: [ 969.843779] env[65446]: Traceback (most recent call last): [ 969.844062] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 969.844062] env[65446]: listener.cb(fileno) [ 969.844062] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 969.844062] env[65446]: result = function(*args, **kwargs) [ 969.844062] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 969.844062] env[65446]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 969.844062] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 969.844062] env[65446]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 969.844062] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 969.844062] env[65446]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 969.844062] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 969.844062] env[65446]: res.raise_for_status() [ 969.844062] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 969.844062] env[65446]: raise HTTPError(http_error_msg, response=self) [ 969.844062] env[65446]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e86ba0be-f9c3-46c0-93b8-48259d0b813b [ 969.844062] env[65446]: Removing descriptor: 60 [ 970.120405] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: SUCCESS [ 970.120596] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 deletion is rescheduled due to dependency. [ 970.120713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.120973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.121109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.121316] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.121436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.121511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.121675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.121755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.121868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.121968] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.122857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.123501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.123501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.123501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.123501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.123725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.123725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.123725] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.625874] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.627402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.627585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.627632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.627853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.649216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.649216] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.649216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.649216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.649216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.649216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.649216] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be updated. [ 970.675260] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.675468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.675468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.679028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.679028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.686015] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: IN_PROGRESS for 2s [ 970.893437] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 970.893659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.130257] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052: rpc.has_security_group_logging(os_id): False [ 971.132814] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 971.133097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.133312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.133561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.133753] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.133901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.133990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.134344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.134344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.134463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.134463] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.135399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.135589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.135754] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.135863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.135928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.136077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.136142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.136227] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.152917] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.152917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.152917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.153722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.153722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.153722] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.153722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.153722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.153722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.153946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.153946] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be updated. [ 971.218043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.218043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.218043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.218344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.218418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.232219] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: IN_PROGRESS for 2s [ 971.438240] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 in Status: SUCCESS [ 971.438240] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 deletion is rescheduled due to dependency. [ 971.438240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.564487] env[65446]: INFO networking_nsxv3.common.synchronization [req-681a1f7f-494e-4769-be6b-91499b28b330 req-e8b89ddf-8fd2-438e-b83b-bf72b688adea tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 971.565040] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 971.565375] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.565496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.565535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.565753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.565995] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.565995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.566131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.566948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.567057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.567244] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.577684] env[65446]: INFO networking_nsxv3.common.synchronization [req-cfadc924-55ac-443a-a9ba-a58420fe569a req-8cf70181-db28-482a-92c0-893fd3ebdd28 tempest-ServersNegativeTestJSON-1295958692 tempest-ServersNegativeTestJSON-1295958692-project-member] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 971.578266] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 971.578563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.578679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.578747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.578931] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.579102] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.579198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.579289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.579404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.579489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.579581] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.639138] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.639138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.639138] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.906668] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.906806] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.906924] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.907262] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.907870] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.908053] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.908178] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.908429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.909029] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.909029] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.909029] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.909029] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.909215] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.909215] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.909541] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.909541] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.929158] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.929376] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.929530] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.929716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.930056] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-a60d443c-8078-4b62-bb5c-1adab3041180 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.930236] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.930359] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.930701] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.930842] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a60d443c-8078-4b62-bb5c-1adab3041180',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.070653] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.070819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.070916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.071148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.082338] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.092568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.092824] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.092941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.093015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.093213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.093289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.093381] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 972.119151] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.119335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.119403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.119624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.119763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.128756] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 972.141765] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.433054] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.433265] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.433434] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.433728] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.433883] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.434054] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port a60d443c-8078-4b62-bb5c-1adab3041180 not found, creating... [ 972.434370] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.434488] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.434616] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.434829] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.434967] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.435369] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.435558] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.435680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.435885] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.436026] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.436169] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: a60d443c-8078-4b62-bb5c-1adab3041180 is going to be created. [ 972.456475] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.456713] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.456796] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.457087] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.457395] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.457643] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.584790] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.647220] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.647220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.647220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.647763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.647763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.647763] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 972.697476] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.697659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.697714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.697913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.698171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.702421] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: SUCCESS [ 972.702726] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 deletion is rescheduled due to dependency. [ 972.702726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.710130] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 973.087575] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.087912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.087912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.088364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.088469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.088635] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 973.124927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.125079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.125985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.125985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.125985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.137461] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 973.193588] env[65446]: INFO networking_nsxv3.common.synchronization [req-681a1f7f-494e-4769-be6b-91499b28b330 req-ade306bc-cf84-4831-b1ba-8130ceac2250 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 973.193588] env[65446]: INFO networking_nsxv3.common.synchronization [req-681a1f7f-494e-4769-be6b-91499b28b330 req-ade306bc-cf84-4831-b1ba-8130ceac2250 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 973.193737] env[65446]: INFO networking_nsxv3.common.synchronization [req-681a1f7f-494e-4769-be6b-91499b28b330 req-ade306bc-cf84-4831-b1ba-8130ceac2250 service nova] Enqueued Resource ID: a60d443c-8078-4b62-bb5c-1adab3041180 with Priority: HIGHEST for action port [ 973.194196] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 973.194328] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 973.194423] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60d443c-8078-4b62-bb5c-1adab3041180 with Priority: HIGHEST for action port [ 973.195505] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.195505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.195505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.195784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.195784] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.196468] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.196583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.196803] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-a60d443c-8078-4b62-bb5c-1adab3041180 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.196921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.196991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.197118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.197224] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a60d443c-8078-4b62-bb5c-1adab3041180',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.259354] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 in Status: SUCCESS [ 973.259354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.699633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.699633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.699633] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a60d443c-8078-4b62-bb5c-1adab3041180 with status ACTIVE [ 973.699633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.700094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.700094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.700094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.700094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.700256] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.700302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.700408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.700532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.700562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.700826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.700826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.700921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.700986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.701087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.701195] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a60d443c-8078-4b62-bb5c-1adab3041180 is going to be updated. [ 973.722399] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.722557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.722597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.722822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.722955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.723126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a60d443c-8078-4b62-bb5c-1adab3041180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.066395] env[65446]: INFO networking_nsxv3.common.synchronization [req-5bfb849a-6ccf-4d1e-ad1b-c04dfd98302f req-8139e769-b760-4f8e-90ea-a8772d7fe78f tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 974.066917] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 974.067291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.067443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.067493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.067781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.067877] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.067966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.068033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.068206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.068257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.068349] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.141777] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 974.141989] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 974.142118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.142292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.142555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.142751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.142868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.142944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.143160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.143247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.143363] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.467840] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.468049] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.468181] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.470076] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.470383] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.470549] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.470667] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.470892] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.471050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.471255] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.471368] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.471477] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.471584] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.471690] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.471792] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.471919] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.490574] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.490738] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.490874] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.491066] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.491370] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.491539] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.491657] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.491976] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.492125] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a426a7c-e8aa-4025-93b6-2ba03d79b0ac',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.570812] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.645720] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.722240] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 974.722240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.722240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.722757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.722757] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.722757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.722757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.722926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.722960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.723034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.723195] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.723287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.723345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.723484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.723613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.723700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.723757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.723885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.723957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.724041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.724126] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.995158] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.995438] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.995599] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.995912] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.996105] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.996295] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 7a426a7c-e8aa-4025-93b6-2ba03d79b0ac not found, creating... [ 974.996559] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.996716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.996831] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.997062] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.997239] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.997523] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.997677] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.997792] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.997993] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.998142] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.998298] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 7a426a7c-e8aa-4025-93b6-2ba03d79b0ac is going to be created. [ 975.017629] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.017843] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.018179] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.018244] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.018545] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.018768] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.074559] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.149095] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.151992] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 975.152318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.226584] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d360f67e-96d2-41e3-87bd-00f87fb4fd70: rpc.has_security_group_logging(os_id): False [ 975.249610] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.249798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.249913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.250143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.270373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.270684] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.270872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.270929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.271768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.271768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.271768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.271768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.271768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.271768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.272213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.272213] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.272213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.272312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.272373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.272847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.272847] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 975.368980] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.369265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.369265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.369444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.369643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.390506] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 975.576503] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.576736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.576736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.577037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.577125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.577225] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 975.612865] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.613107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.613222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.613452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.613605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.623380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 975.653741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.653741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.653741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.653741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.653741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.653741] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 975.687806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.687953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.688041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.688265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.688425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.698206] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 975.771726] env[65446]: INFO networking_nsxv3.common.synchronization [req-5bfb849a-6ccf-4d1e-ad1b-c04dfd98302f req-fcfd3c5e-bd9c-4df1-b7da-6bad4002c7ea service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 975.771930] env[65446]: INFO networking_nsxv3.common.synchronization [req-5bfb849a-6ccf-4d1e-ad1b-c04dfd98302f req-fcfd3c5e-bd9c-4df1-b7da-6bad4002c7ea service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 975.772063] env[65446]: INFO networking_nsxv3.common.synchronization [req-5bfb849a-6ccf-4d1e-ad1b-c04dfd98302f req-fcfd3c5e-bd9c-4df1-b7da-6bad4002c7ea service nova] Enqueued Resource ID: 7a426a7c-e8aa-4025-93b6-2ba03d79b0ac with Priority: HIGHEST for action port [ 975.772613] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 975.772769] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 975.772870] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a426a7c-e8aa-4025-93b6-2ba03d79b0ac with Priority: HIGHEST for action port [ 975.775245] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.775407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.775467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.775691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.775779] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.776737] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.776840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.777147] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.777600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.777673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.777917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.778095] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a426a7c-e8aa-4025-93b6-2ba03d79b0ac',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.280349] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.280556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.280747] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a426a7c-e8aa-4025-93b6-2ba03d79b0ac with status ACTIVE [ 976.280923] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.281068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.281139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.281354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.281444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.281623] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.281721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.281774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.281926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.282013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.282199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.282314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.282394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.282543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.282618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.282706] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a426a7c-e8aa-4025-93b6-2ba03d79b0ac is going to be updated. [ 976.332074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.332235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.332307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.332513] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.332650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.332807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a426a7c-e8aa-4025-93b6-2ba03d79b0ac" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.414495] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 977.414495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.635699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 977.636061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.636339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.636650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.636933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.637126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.637280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.637485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.637568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.637664] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.707526] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 977.707743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.707907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.708216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.708435] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.708607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.708673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.708836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.708913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.708996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.709100] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.144364] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.214031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.214031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.214031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.214031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.214031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.214763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.214763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.214763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.214763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.214763] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.647292] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.718654] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184: rpc.has_security_group_logging(os_id): False [ 978.740033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.740033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.740033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.740033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.740686] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.740686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.740686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.742040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.742336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.742892] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 978.829933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.829933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.829933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.829933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.829933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.848447] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 979.151244] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.151244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.151244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.151244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.151244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.151244] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 979.198789] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.198789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.198789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.198789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.198789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.214353] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 980.774287] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 980.774287] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 980.871216] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 980.871926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.228802] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 4s [ 981.309768] env[65446]: INFO networking_nsxv3.common.synchronization [None req-be1fce29-e8dc-473f-90f0-4d9ddf6684ee None None] Enqueued Resource ID: af7960bf-12e2-4d05-a27b-42978e4e6087 with Priority: HIGHEST for action port [ 981.310433] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af7960bf-12e2-4d05-a27b-42978e4e6087 with Priority: HIGHEST for action port [ 981.310433] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-af7960bf-12e2-4d05-a27b-42978e4e6087 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.310433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af7960bf-12e2-4d05-a27b-42978e4e6087" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.310433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af7960bf-12e2-4d05-a27b-42978e4e6087" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.310803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af7960bf-12e2-4d05-a27b-42978e4e6087" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.310803] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7960bf-12e2-4d05-a27b-42978e4e6087',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.812428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af7960bf-12e2-4d05-a27b-42978e4e6087 [ 981.812803] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.812876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.812876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.813147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.813239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.813688] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af7960bf-12e2-4d05-a27b-42978e4e6087 already deleted. [ 981.813688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af7960bf-12e2-4d05-a27b-42978e4e6087" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.166062] env[65446]: INFO networking_nsxv3.common.synchronization [req-eb104b1a-ff06-4466-95e9-bf6056e5bdfc req-928d8f09-8964-4fab-8984-0d33f8e3d2f0 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 982.167016] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 982.167142] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.167224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.167300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.167880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.167880] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.167880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.167880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.168063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.168111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.168244] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.671739] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.705507] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.706753] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.706753] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.707368] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.708296] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.709514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.709514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.709514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.709514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.712019] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.712019] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.712019] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.712019] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.712019] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.712019] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.712019] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.746162] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.746162] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.746162] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.746162] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.746162] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-fcd288f6-698d-40a4-bfdb-dc65da630875 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.746162] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.746162] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.746950] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.746950] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd288f6-698d-40a4-bfdb-dc65da630875',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.176026] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.241646] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 983.241889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.242073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.242386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.242768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.242768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.242909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.243054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.243145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.243234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.243328] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.249249] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.249544] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.249698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.249970] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.250259] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.250383] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port fcd288f6-698d-40a4-bfdb-dc65da630875 not found, creating... [ 983.250586] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.250874] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.251392] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.251392] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.251590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.251930] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.252114] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.252249] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.252443] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.252579] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.252756] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: fcd288f6-698d-40a4-bfdb-dc65da630875 is going to be created. [ 983.280470] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.280760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.280856] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.281191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.281460] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.281743] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.344668] env[65446]: INFO networking_nsxv3.common.synchronization [req-3630f1cc-d11d-4bf4-89cb-5bffe702292c req-c177df77-fe3c-4850-811e-aba35fcd7c52 tempest-ServersAdminTestJSON-228595505 tempest-ServersAdminTestJSON-228595505-project-member] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 983.344982] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGHEST for action security_group_members [ 983.345364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.345520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.345568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.345758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.345921] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.346033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.346118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.346254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.346336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.346432] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.679833] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.680133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.680133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.680321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.680370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.680458] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 983.714838] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.715055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.715121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.715322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.715530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.730075] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 983.746552] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.746767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.746767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.746987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.747140] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.747281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.747392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.747589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.747699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.747796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.747990] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.748143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.748217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.748374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.748539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.748653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.748728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.748844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.748923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.749036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.749163] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.752319] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d94906c8-56a8-4d10-863e-21845e1b664c None None] Enqueued Resource ID: 15852b6b-5a91-48e2-bd06-9afe626087a4 with Priority: HIGHEST for action port [ 983.752574] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15852b6b-5a91-48e2-bd06-9afe626087a4 with Priority: HIGHEST for action port [ 983.753177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-15852b6b-5a91-48e2-bd06-9afe626087a4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.753374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15852b6b-5a91-48e2-bd06-9afe626087a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.753374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15852b6b-5a91-48e2-bd06-9afe626087a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.753633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15852b6b-5a91-48e2-bd06-9afe626087a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.753724] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15852b6b-5a91-48e2-bd06-9afe626087a4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.849035] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.849035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.849035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.850824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.878379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.878536] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.878601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.878636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.878820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.878904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.878997] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be updated. [ 983.924183] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.924372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.924453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.924687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.924838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.939981] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: IN_PROGRESS for 2s [ 984.029584] env[65446]: INFO networking_nsxv3.common.synchronization [req-eb104b1a-ff06-4466-95e9-bf6056e5bdfc req-4e8b40ed-a902-4e33-9249-f1f6175ad4f3 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 984.029584] env[65446]: INFO networking_nsxv3.common.synchronization [req-eb104b1a-ff06-4466-95e9-bf6056e5bdfc req-4e8b40ed-a902-4e33-9249-f1f6175ad4f3 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 984.029584] env[65446]: INFO networking_nsxv3.common.synchronization [req-eb104b1a-ff06-4466-95e9-bf6056e5bdfc req-4e8b40ed-a902-4e33-9249-f1f6175ad4f3 service nova] Enqueued Resource ID: fcd288f6-698d-40a4-bfdb-dc65da630875 with Priority: HIGHEST for action port [ 984.029584] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 984.029584] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 984.029807] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd288f6-698d-40a4-bfdb-dc65da630875 with Priority: HIGHEST for action port [ 984.030040] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.030198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.030323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.030554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.030683] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.031687] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.031687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.031844] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcd288f6-698d-40a4-bfdb-dc65da630875 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.032140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.032140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.032216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.032302] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd288f6-698d-40a4-bfdb-dc65da630875',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.251254] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857e4e4f-84a2-43c7-870d-f3776015cb13: rpc.has_security_group_logging(os_id): False [ 984.257168] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15852b6b-5a91-48e2-bd06-9afe626087a4 [ 984.257521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.257702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.257794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.258032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.258123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.258222] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15852b6b-5a91-48e2-bd06-9afe626087a4 already deleted. [ 984.258312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15852b6b-5a91-48e2-bd06-9afe626087a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.279948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.279948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.279948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.280346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.297048] env[65446]: INFO networking_nsxv3.common.synchronization [req-a2a7d392-7a20-407d-88a1-eb66dfc720bc req-e7b57f17-334d-4788-bfbc-3dddce44b2a3 tempest-ServersWithSpecificFlavorTestJSON-599263955 tempest-ServersWithSpecificFlavorTestJSON-599263955-project-member] Enqueued Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 984.297674] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 with Priority: HIGHEST for action security_group_members [ 984.298381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-73f89999-ebe2-4491-b7a9-a88502cfe139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.298381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.298381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.298542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.298801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.298801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.298801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.298937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.299184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.299288] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73f89999-ebe2-4491-b7a9-a88502cfe139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.320330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.320670] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.320973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.321357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.321456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.321495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.321710] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.321825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.321888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.322271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.322425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.323074] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.323178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.323506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.323576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.323612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.323699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 984.393047] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.393198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.393272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.393657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.393657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.413190] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 984.534520] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.541033] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcd288f6-698d-40a4-bfdb-dc65da630875 with status ACTIVE [ 984.541033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.541033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.541033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.541033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.541859] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcd288f6-698d-40a4-bfdb-dc65da630875 is going to be updated. [ 984.568642] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.570076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.570076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.570076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.570214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.570701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcd288f6-698d-40a4-bfdb-dc65da630875" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.718618] env[65446]: INFO networking_nsxv3.common.synchronization [req-86317a7c-54a3-4928-8b51-f6ea15bec4d7 req-b27c7f9a-c653-4172-93c8-c6283de8b7e7 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_members [ 984.718885] env[65446]: INFO networking_nsxv3.common.synchronization [req-86317a7c-54a3-4928-8b51-f6ea15bec4d7 req-b27c7f9a-c653-4172-93c8-c6283de8b7e7 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 984.718987] env[65446]: INFO networking_nsxv3.common.synchronization [req-86317a7c-54a3-4928-8b51-f6ea15bec4d7 req-b27c7f9a-c653-4172-93c8-c6283de8b7e7 tempest-SecurityGroupsTestJSON-532505633 tempest-SecurityGroupsTestJSON-532505633-project-member] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 984.719523] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGHEST for action security_group_members [ 984.719753] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGHEST for action security_group_members [ 984.719789] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGHEST for action security_group_members [ 984.722488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef2378e4-6034-4c52-b983-3b0244de565d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.723923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.724052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.724313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.724539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.724737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.725615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.725615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.725615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.725615] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.726943] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.727165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.727248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.727438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.727600] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.727698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.727761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.727920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.728146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.728201] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.730908] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.731073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.731186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.731602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.731750] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.731846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.731907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.732133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.732221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.732344] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.800972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.802059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.802059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.802059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.828471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.828471] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.828471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.828471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.828471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.828471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.828471] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 is going to be updated. [ 984.867142] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.867142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.867142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.867142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.867142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.887395] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: IN_PROGRESS for 2s [ 985.227867] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.228107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.228189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.228448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.234815] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.234815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.234815] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.234815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.253816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.254309] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.254407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.254407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.254698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.254752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.254891] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef2378e4-6034-4c52-b983-3b0244de565d is going to be updated. [ 985.256278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.256538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.257314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.257314] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.257314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.257314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.257487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.257487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.257568] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be updated. [ 985.259214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.259475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.312021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.312021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.312021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.312021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.312419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.312419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.312419] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be updated. [ 985.318404] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.318499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.318606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.318945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.319116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.322546] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.322546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.322546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.322546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.322546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.334266] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: IN_PROGRESS for 2s [ 985.338185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: IN_PROGRESS for 2s [ 985.365812] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.365812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.365812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.365812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.365812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.375903] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: IN_PROGRESS for 2s [ 985.744577] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 985.744804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.745545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.745797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.746115] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.746249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.746249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.746579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.746704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.746817] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.955644] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 in Status: SUCCESS [ 985.955911] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 deletion is rescheduled due to dependency. [ 985.956075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.251302] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.431558] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 986.432030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.757090] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.899219] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 in Status: SUCCESS [ 986.899415] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73f89999-ebe2-4491-b7a9-a88502cfe139 deletion is rescheduled due to dependency. [ 986.899534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73f89999-ebe2-4491-b7a9-a88502cfe139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.191483] env[65446]: INFO networking_nsxv3.common.synchronization [None req-805aa4d8-8dfb-4410-a41a-f77b517cbc7b None None] Enqueued Resource ID: f76109f9-77fd-4117-b176-1d58bbb853bc with Priority: HIGHEST for action port [ 987.191743] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76109f9-77fd-4117-b176-1d58bbb853bc with Priority: HIGHEST for action port [ 987.194574] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-f76109f9-77fd-4117-b176-1d58bbb853bc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.194574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f76109f9-77fd-4117-b176-1d58bbb853bc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.194574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f76109f9-77fd-4117-b176-1d58bbb853bc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.194574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f76109f9-77fd-4117-b176-1d58bbb853bc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.194574] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f76109f9-77fd-4117-b176-1d58bbb853bc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.263643] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.263643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.263643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.263643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.263643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.263643] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 987.302605] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.302833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.302833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.303459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.303598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.320855] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 987.346464] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 in Status: SUCCESS [ 987.346643] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 deletion is rescheduled due to dependency. [ 987.346760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.347987] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef2378e4-6034-4c52-b983-3b0244de565d in Status: SUCCESS [ 987.347987] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef2378e4-6034-4c52-b983-3b0244de565d deletion is rescheduled due to dependency. [ 987.347987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.408044] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 in Status: SUCCESS [ 987.408237] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 deletion is rescheduled due to dependency. [ 987.410015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.696813] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f76109f9-77fd-4117-b176-1d58bbb853bc [ 987.697250] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.697250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.697250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.697549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.697612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.697767] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f76109f9-77fd-4117-b176-1d58bbb853bc already deleted. [ 987.697767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f76109f9-77fd-4117-b176-1d58bbb853bc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.996493] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e303003f-0bcd-44e2-b7cc-c683af7973d4 tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 987.997320] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 987.998062] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.998236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.998416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.998683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.998683] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.090865] env[65446]: INFO networking_nsxv3.common.synchronization [None req-57d9e534-f6e7-433a-8773-e652b0d3e977 tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 988.091255] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 988.091887] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.091887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.521203] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.523706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.523706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.523706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.523706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.523706] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e already deleted. [ 988.523706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.523706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.523706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.523706] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.048144] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.048144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.048144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.048144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.048144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.048144] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e already deleted. [ 989.048144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.336685] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.336685] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.336685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.336685] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.593964] env[65446]: INFO networking_nsxv3.common.synchronization [req-912c9287-fa73-404e-b0d9-5f605032e018 req-4b0cb93e-d8ec-4629-a537-242ca27fd2aa tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 989.595321] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 989.596813] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.598020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.598020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.598020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.598285] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.598593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.598816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.599223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.599472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.600650] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.842385] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.842579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.842712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.842968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.843181] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.843332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.843416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.843597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.843714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.843828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.844023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.844143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.844233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.844397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.844556] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.844675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.844738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.844924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.845026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.845128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.845463] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.102664] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.102968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.102968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.103154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.103245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.103474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.103578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.103640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.103788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.103866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.103950] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 990.136042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.136042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.136042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.136042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.136261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.146267] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 990.348416] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 990.371043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.371216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.371290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.371503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.392539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.392539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.392539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.392539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.392718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.392718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.392882] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.392992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.393078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.393248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.393339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.393543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.393655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.393718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.393860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.393951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.394440] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 990.459910] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.459910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.459910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.459910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.459910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.475569] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 990.513103] env[65446]: INFO networking_nsxv3.common.synchronization [None req-62fa3603-b01f-44c1-a823-ddde74b23e27 None None] Enqueued Resource ID: 71b7ec03-a176-499d-bcc1-79d02678ea2d with Priority: HIGHEST for action port [ 990.513436] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b7ec03-a176-499d-bcc1-79d02678ea2d with Priority: HIGHEST for action port [ 990.514402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b7ec03-a176-499d-bcc1-79d02678ea2d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.514824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b7ec03-a176-499d-bcc1-79d02678ea2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.514923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b7ec03-a176-499d-bcc1-79d02678ea2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.515233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b7ec03-a176-499d-bcc1-79d02678ea2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.515357] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b7ec03-a176-499d-bcc1-79d02678ea2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.021030] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71b7ec03-a176-499d-bcc1-79d02678ea2d [ 991.021030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.021437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.021583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.022457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.022553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.022678] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71b7ec03-a176-499d-bcc1-79d02678ea2d already deleted. [ 991.022930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b7ec03-a176-499d-bcc1-79d02678ea2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.157388] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 992.157758] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 992.158955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.352900] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d8fbb34-f2a3-4ee2-9090-657db9301a93 req-07c16383-f703-486e-a41c-7efd6589b242 tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 992.353604] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 992.353930] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.354087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.354174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.354401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.354635] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.354748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.354748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.354862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.354944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.355048] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.496285] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 992.496546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.701805] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.702019] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.702151] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.702489] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.702763] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.702967] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.703045] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.703266] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.703410] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.703702] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.703796] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.703924] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.704051] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.704168] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.704277] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.704926] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.724987] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.725204] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.725351] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.725533] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.725851] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-7febecbb-9acd-4284-a20b-0e55bf216f36 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.726097] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.726147] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.726470] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.726678] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7febecbb-9acd-4284-a20b-0e55bf216f36',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.858477] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.858653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.858823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.858990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.859158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.859390] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.859548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.859607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.859830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.859938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.860069] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca already deleted. [ 992.860166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.229500] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.229800] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.229908] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.230365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.230365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.230621] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 7febecbb-9acd-4284-a20b-0e55bf216f36 not found, creating... [ 993.230799] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.230961] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.231093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.231315] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.231458] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.231762] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.233032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.233032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.233032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.233032] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.233032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 7febecbb-9acd-4284-a20b-0e55bf216f36 is going to be created. [ 993.256247] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.256466] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.256594] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.256894] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.257125] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.257412] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.991627] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d8fbb34-f2a3-4ee2-9090-657db9301a93 req-f9d61ccf-810a-48f6-9e27-9b2177f38a67 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 993.991813] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d8fbb34-f2a3-4ee2-9090-657db9301a93 req-f9d61ccf-810a-48f6-9e27-9b2177f38a67 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 993.991953] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d8fbb34-f2a3-4ee2-9090-657db9301a93 req-f9d61ccf-810a-48f6-9e27-9b2177f38a67 service nova] Enqueued Resource ID: 7febecbb-9acd-4284-a20b-0e55bf216f36 with Priority: HIGHEST for action port [ 993.992515] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 993.992579] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 993.992666] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7febecbb-9acd-4284-a20b-0e55bf216f36 with Priority: HIGHEST for action port [ 993.992933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.993229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.993283] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.993926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.994944] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.996120] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.997678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.997678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.997678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.997678] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.997678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.997678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.997678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.997678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.997678] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.998856] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-7febecbb-9acd-4284-a20b-0e55bf216f36 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.998856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.998856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.998856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.999101] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7febecbb-9acd-4284-a20b-0e55bf216f36',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.327706] env[65446]: INFO networking_nsxv3.common.synchronization [req-999f2248-3e29-4167-836b-b459f7f179b8 req-86f7671b-3be3-4f2a-8adb-a088c3e260b5 tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 994.328589] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 994.328706] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.328859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.328953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.329199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.329394] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.329694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.329694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.329783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.329890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.330017] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.501291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.501291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.501291] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.502028] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7febecbb-9acd-4284-a20b-0e55bf216f36 with status ACTIVE [ 994.502219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.502331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.502395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.502626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.502712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.502883] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.502987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.503062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.503222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.504068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.504068] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.504068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.504068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.504068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.504068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.504068] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7febecbb-9acd-4284-a20b-0e55bf216f36 is going to be updated. [ 994.528007] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.528174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.528264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.528461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.528602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.528882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7febecbb-9acd-4284-a20b-0e55bf216f36" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.833114] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.009050] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.334817] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.514418] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.514636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.514711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.514907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.515023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.515126] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be created. [ 995.544337] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.544593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.544593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.544850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.545036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.558997] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: UNINITIALIZED for 2s [ 995.841480] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.841480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.841643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.841739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.841826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.841920] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 995.888972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.889170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.889211] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.889729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.889729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.900282] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 996.968519] env[65446]: INFO networking_nsxv3.common.synchronization [req-6911be31-d64b-4c45-9ddf-07035d96d175 req-6150122a-b069-49ff-941d-e0996af8b92f tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 996.969264] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 996.970055] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.970564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.971056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.971342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.971521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.971620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.971715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.971852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.971937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.972047] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.381020] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.381020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.381020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.381020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.381020] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.381020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.381020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.381020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.381020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.381020] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.381020] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.381020] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.381020] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.381695] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.381695] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.381695] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.401420] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.401420] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.401420] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.401420] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.401420] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-cda7f4f7-5287-468c-8433-4e25bead9dc8 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.401420] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.401420] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.401716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.401716] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda7f4f7-5287-468c-8433-4e25bead9dc8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.476169] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.476310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.476369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.476572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.477226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.477226] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.477226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.477226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.477226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.477986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.477986] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e already deleted. [ 997.477986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.568953] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 997.569866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.569866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.569866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.569866] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.569866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.569866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.570115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.570115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.570115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.570249] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.907017] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.907017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.907017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.907017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.907017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.907017] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port cda7f4f7-5287-468c-8433-4e25bead9dc8 not found, creating... [ 997.907017] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.907017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.907429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.907429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.907429] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.911224] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.911466] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.911592] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.911829] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.911967] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.912232] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 is going to be created. [ 997.913997] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 997.914314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.936728] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.936728] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.936728] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.937435] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.937435] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.937435] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.073067] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.073487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.073487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.073702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.073912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.074764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.074894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.075194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.075377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.075455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.076072] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.076072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.076072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.076270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.076875] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.077516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.077516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.077706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.078248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.078248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.078248] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.297868] env[65446]: INFO networking_nsxv3.common.synchronization [req-a9248dee-acdc-4eb8-8478-5edeb5132156 req-aeb5106d-8ca3-441a-9a8b-2f4c5b481492 tempest-ServersV294TestFqdnHostnames-1003052055 tempest-ServersV294TestFqdnHostnames-1003052055-project-member] Enqueued Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_members [ 998.299300] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGHEST for action security_group_members [ 998.299300] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.299489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.299489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.300087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.300087] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.300087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.300087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.300303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.300397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.300727] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.582907] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71307925-e0d7-49c9-8bc8-5c5e870d7bca: rpc.has_security_group_logging(os_id): False [ 998.602896] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.604045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.604045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.604045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.604045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.604045] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.604454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.604454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.604454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.604454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.604713] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.604788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.604788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.604947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.605065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.605294] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.605358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.605396] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.605522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.605596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.605680] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be created. [ 998.670228] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.670446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.670541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.670777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.670984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.680580] env[65446]: INFO networking_nsxv3.common.synchronization [req-6911be31-d64b-4c45-9ddf-07035d96d175 req-bd43bb90-27f5-400a-8e1a-9b114fe0aadb service nova] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 998.680580] env[65446]: INFO networking_nsxv3.common.synchronization [req-6911be31-d64b-4c45-9ddf-07035d96d175 req-bd43bb90-27f5-400a-8e1a-9b114fe0aadb service nova] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 998.680580] env[65446]: INFO networking_nsxv3.common.synchronization [req-6911be31-d64b-4c45-9ddf-07035d96d175 req-bd43bb90-27f5-400a-8e1a-9b114fe0aadb service nova] Enqueued Resource ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 with Priority: HIGHEST for action port [ 998.680935] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 998.681134] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 998.681268] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 with Priority: HIGHEST for action port [ 998.681611] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.681737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.681802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.682043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.682166] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.683700] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.683900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.683900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.684184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.684443] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.684562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.684625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.684774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.684859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.685170] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.687063] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-cda7f4f7-5287-468c-8433-4e25bead9dc8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.687198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.687235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.687416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.687494] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda7f4f7-5287-468c-8433-4e25bead9dc8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.690165] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 998.803381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.803704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.803766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.803977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.829210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.829210] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.829210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.829210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.829210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.829210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.829210] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae is going to be updated. [ 998.855768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.855938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.855938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.856580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.856580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.864431] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd996317-fb1b-4d07-a8c8-969fa47508ae in Status: IN_PROGRESS for 2s [ 999.188295] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.190339] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.190649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.193060] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cda7f4f7-5287-468c-8433-4e25bead9dc8 with status ACTIVE [ 999.193658] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.193743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.193780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.194181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.194181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.194280] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.194575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.194575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.194575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.194679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.195191] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.195191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.195191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.195191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.195191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.195966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 is going to be updated. [ 999.217546] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.217708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.217763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.217972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.218130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.218305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.694755] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.202068] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.202068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.202068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.202515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.202515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.202515] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e is going to be created. [ 1000.226411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.226556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.226600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.226803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.226962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.238802] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: UNINITIALIZED for 2s [ 1000.449072] env[65446]: INFO networking_nsxv3.common.synchronization [None req-277729eb-1f3f-4083-85ea-e68f2a193841 None None] Enqueued Resource ID: bb635fe5-1121-48a5-af23-03db42319b8c with Priority: HIGHEST for action port [ 1000.449799] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb635fe5-1121-48a5-af23-03db42319b8c with Priority: HIGHEST for action port [ 1000.449799] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb635fe5-1121-48a5-af23-03db42319b8c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.449799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb635fe5-1121-48a5-af23-03db42319b8c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.450060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb635fe5-1121-48a5-af23-03db42319b8c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.450232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb635fe5-1121-48a5-af23-03db42319b8c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.450313] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb635fe5-1121-48a5-af23-03db42319b8c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.703061] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1000.703448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.875146] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd996317-fb1b-4d07-a8c8-969fa47508ae in Status: SUCCESS [ 1000.875146] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae deletion is rescheduled due to dependency. [ 1000.875146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.955788] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb635fe5-1121-48a5-af23-03db42319b8c [ 1000.955788] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.955788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.955788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.955788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.955788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.955788] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb635fe5-1121-48a5-af23-03db42319b8c already deleted. [ 1000.955788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb635fe5-1121-48a5-af23-03db42319b8c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.293334] env[65446]: INFO networking_nsxv3.common.synchronization [None req-07289470-a6e9-4dc2-a94f-3426a95ca638 tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_rules [ 1001.293714] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_rules [ 1001.294041] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.294168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.294226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.294481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.294565] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.424904] env[65446]: INFO networking_nsxv3.common.synchronization [None req-672d0d31-4899-4527-bf64-27469370cc0b tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_rules [ 1001.425508] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_rules [ 1001.425819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.425932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.816201] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.816201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.816201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.816201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.816201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.816201] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 already deleted. [ 1001.816462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.816462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.816774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.816774] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.250730] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: SUCCESS [ 1002.251087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.251178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.251438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.251644] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.251759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.251820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.252024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.252550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.252550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.252550] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.342920] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.343265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.343265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.343542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.343679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.343902] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 already deleted. [ 1002.343969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.760233] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.984989] env[65446]: INFO networking_nsxv3.common.synchronization [None req-473f737d-cab5-4bf7-8bfb-c8d7384cdd85 None None] Enqueued Resource ID: 2f6270f1-edb8-4171-ad26-82f36ea85ee0 with Priority: HIGHEST for action port [ 1002.985875] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f6270f1-edb8-4171-ad26-82f36ea85ee0 with Priority: HIGHEST for action port [ 1002.986216] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f6270f1-edb8-4171-ad26-82f36ea85ee0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.986315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f6270f1-edb8-4171-ad26-82f36ea85ee0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.986402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f6270f1-edb8-4171-ad26-82f36ea85ee0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.986665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f6270f1-edb8-4171-ad26-82f36ea85ee0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.986754] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f6270f1-edb8-4171-ad26-82f36ea85ee0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.263709] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b57e5c1-c933-4317-815e-0311cc4e843e: rpc.has_security_group_logging(os_id): False [ 1003.281163] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.281338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.281391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.281580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.281668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.281955] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.282078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.282141] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.282285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.282362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.282453] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e is going to be created. [ 1003.343825] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.343825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.343825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.344163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.344163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.357329] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: IN_PROGRESS for 2s [ 1003.489783] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f6270f1-edb8-4171-ad26-82f36ea85ee0 [ 1003.490020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.490167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.490232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.490435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.490522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.490612] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f6270f1-edb8-4171-ad26-82f36ea85ee0 already deleted. [ 1003.490689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f6270f1-edb8-4171-ad26-82f36ea85ee0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.935060] env[65446]: INFO networking_nsxv3.common.synchronization [req-c4bf8414-c702-4ecd-ae81-6db80614163b req-80295263-15b2-42ad-9a1e-826108094831 tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1003.936100] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1003.936450] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.936548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.936654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.937178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.937322] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.937486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.937587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.937824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.937954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.938113] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.349808] env[65446]: INFO networking_nsxv3.common.synchronization [req-9acb1b18-395b-4685-b818-4367f05608c6 req-a3af6630-9352-4392-a096-fe7dfe74da83 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1004.350479] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1004.350847] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.351027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.351128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.351398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.351613] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.352084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.352163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.354041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.354041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.354041] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.442354] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.442711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.443217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.443516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.443818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.444180] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.444453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.444677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.447020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.447020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.447020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 1004.477412] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.477614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.477684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.477904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.478055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.489830] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 1004.707030] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.707030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.707030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.707030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.707660] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.708038] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.711018] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.711018] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.711018] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.711018] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.711018] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.711018] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.711018] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.711018] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.711018] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.711018] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.730594] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.730739] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.730918] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.731178] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.731537] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.731757] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.731926] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.732396] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.732581] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.854674] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.235248] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.235503] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.235674] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.235916] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.236073] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.236229] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 not found, creating... [ 1005.236486] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.236641] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.236759] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.236973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.237121] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.237416] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.237580] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.237698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.237904] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.238047] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.238191] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 is going to be created. [ 1005.259786] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.260020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.260152] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.260486] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.260728] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.260994] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.357591] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.378072] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: SUCCESS [ 1005.378395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.861354] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.861612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.861612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.861808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.862083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.862083] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1005.893695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.893824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.893918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.894161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.894305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.906765] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1006.043876] env[65446]: INFO networking_nsxv3.common.synchronization [req-9acb1b18-395b-4685-b818-4367f05608c6 req-5267575d-229c-4c73-b3b7-0ff3b62686d5 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 1006.044217] env[65446]: INFO networking_nsxv3.common.synchronization [req-9acb1b18-395b-4685-b818-4367f05608c6 req-5267575d-229c-4c73-b3b7-0ff3b62686d5 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1006.044484] env[65446]: INFO networking_nsxv3.common.synchronization [req-9acb1b18-395b-4685-b818-4367f05608c6 req-5267575d-229c-4c73-b3b7-0ff3b62686d5 service nova] Enqueued Resource ID: 49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 with Priority: HIGHEST for action port [ 1006.045135] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 1006.045339] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1006.045599] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 with Priority: HIGHEST for action port [ 1006.045953] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.046112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.046181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.046392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.046472] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.048403] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.048568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.048804] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.048910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.048975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.049184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.049265] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.500818] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 1006.501190] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 deletion is rescheduled due to dependency. [ 1006.501190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.551935] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.552062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.552756] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 with status ACTIVE [ 1006.552756] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.552756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.552756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.553379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.553379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.553379] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.553379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.553379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.553379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.553674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.553674] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.553674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.553834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.553834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.553922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.553974] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9 is going to be updated. [ 1006.575997] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.576201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.576285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.576532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.576686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.577035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49a0df97-5ee8-4c6b-a4d2-c10ee60cb1e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.916545] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1007.916912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.916977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.917182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.917427] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.917581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.917638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.917786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.917866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.917962] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.420138] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.922676] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.426380] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.426603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.426661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.426990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.427175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.427343] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1009.464948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.464948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.465127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.465567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.465567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.476249] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1011.046419] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1011.046872] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1011.493989] env[65446]: INFO networking_nsxv3.common.synchronization [req-92a06fcd-b5af-4de8-9e4f-f29265824361 req-0d3bf469-dd5e-4549-9d29-432bf477de5f tempest-TenantUsagesTestJSON-1701440320 tempest-TenantUsagesTestJSON-1701440320-project-member] Enqueued Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_members [ 1011.494739] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_members [ 1011.495788] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1011.495992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.496339] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.496494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.496570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.496872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.497045] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.497152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.497217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.497459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.497568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.497733] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.498623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.498814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.498976] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.499093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.499159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.499302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.499379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.499464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.499554] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.862231] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.862485] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.862582] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.862853] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.863142] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.863301] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.863417] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.863639] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.863821] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.864057] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.864202] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.864268] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.864376] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.864482] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.864586] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.864718] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.887418] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.887631] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.887683] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.887865] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-608" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.888210] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-46af5e0b-bc11-486e-b440-f96c7d447630 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.888394] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.888571] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.889024] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.889201] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46af5e0b-bc11-486e-b440-f96c7d447630',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.001270] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.001426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.001492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.001794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.001890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.002110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.002189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.002253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.002411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.002488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.002786] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 already deleted. [ 1012.003156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.003156] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.003247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.003247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.003388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.003524] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.003614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.003672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.003802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.003873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.003952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.004104] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.004194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.004252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.004384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.004527] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.004617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.004675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.004806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.004877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.004955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.005052] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.392305] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.392685] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.392685] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.393111] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.393316] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.393522] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 46af5e0b-bc11-486e-b440-f96c7d447630 not found, creating... [ 1012.393855] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.394055] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.394191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.394493] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.394666] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.395010] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.395175] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.395292] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.395543] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.395684] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.395847] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 46af5e0b-bc11-486e-b440-f96c7d447630 is going to be created. [ 1012.428326] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.428578] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.428701] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.429050] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.429282] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.429927] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.507394] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 1012.548588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.548588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.548740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.548981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.549604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.549604] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.549604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.549604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.549912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.549912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.550095] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.550184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.550232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.550596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.550596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.550701] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.550824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.550908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.551137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.551295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.551397] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1012.720922] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.721174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.721233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.721941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.721941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.772707] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1013.198421] env[65446]: INFO networking_nsxv3.common.synchronization [req-92a06fcd-b5af-4de8-9e4f-f29265824361 req-24041824-9bb2-41c7-bcb2-d724802ad69d service nova] Enqueued Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_rules [ 1013.198421] env[65446]: INFO networking_nsxv3.common.synchronization [req-92a06fcd-b5af-4de8-9e4f-f29265824361 req-24041824-9bb2-41c7-bcb2-d724802ad69d service nova] Enqueued Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_members [ 1013.198421] env[65446]: INFO networking_nsxv3.common.synchronization [req-92a06fcd-b5af-4de8-9e4f-f29265824361 req-24041824-9bb2-41c7-bcb2-d724802ad69d service nova] Enqueued Resource ID: 46af5e0b-bc11-486e-b440-f96c7d447630 with Priority: HIGHEST for action port [ 1013.198947] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_rules [ 1013.198947] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_members [ 1013.200577] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46af5e0b-bc11-486e-b440-f96c7d447630 with Priority: HIGHEST for action port [ 1013.200577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.200577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.200577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.200577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.200577] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.202165] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.202165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.202165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.204040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.204040] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.204040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.204040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.204040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.204040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.204040] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.205634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-46af5e0b-bc11-486e-b440-f96c7d447630 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.205798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.205851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.206070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.206195] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46af5e0b-bc11-486e-b440-f96c7d447630',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.708290] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.708840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.708840] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.709609] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46af5e0b-bc11-486e-b440-f96c7d447630 with status ACTIVE [ 1013.710825] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.710825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.710825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.710825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.710825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.710825] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.710825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.710825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.710825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.711337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.711337] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.711337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.711337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.711714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.711794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.711880] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46af5e0b-bc11-486e-b440-f96c7d447630 is going to be updated. [ 1013.735929] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.735929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.735929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.736101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.736152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.736309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46af5e0b-bc11-486e-b440-f96c7d447630" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.213559] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.717534] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.720551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.720551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.720551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.720551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.720551] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 is going to be created. [ 1014.747329] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.747841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.748069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.748883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.750742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.760890] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 in Status: UNINITIALIZED for 2s [ 1014.789047] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1014.789334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.563963] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1015.563963] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1015.909065] env[65446]: INFO networking_nsxv3.common.synchronization [req-2e861c6c-cd01-4270-a84e-7a175d37b142 req-07458bc6-0a55-4aac-b7ea-7b8528b5c6c8 tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 1015.909065] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 1015.909065] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.909065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.910782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.912373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.912373] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.912373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.912373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.912373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.912373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.912684] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.414939] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.414939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.415116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.416466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.416466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.416466] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.416466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.416466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.416466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.416466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.416466] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 1016.455771] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.455872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.455955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.456280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.456753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.460376] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.460582] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.460710] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.461169] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.461301] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.461435] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.461547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.461813] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.461983] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.462241] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.462373] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.462487] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.462616] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.462770] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.462930] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.463273] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.468364] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 1016.483828] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.484217] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.486611] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.486829] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-230" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.487277] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-74eea6ac-c14d-4183-bd19-a7637291c933 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.487474] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.487646] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.487911] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.488076] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74eea6ac-c14d-4183-bd19-a7637291c933',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.773994] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 in Status: SUCCESS [ 1016.774231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.774420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.774705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.774909] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.775038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.775108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.775261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.775363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.775490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.775596] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.935433] env[65446]: INFO networking_nsxv3.common.synchronization [req-92325c40-3b31-4304-80fd-02dfe4cfac25 req-a03c2015-41c0-4e3f-912c-64ee3dde5a87 tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1016.936086] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1016.936435] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.936599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.936695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.936925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.937129] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.937265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.937354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.937580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.937712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.937837] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.991110] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.991556] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.991695] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.992176] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.992176] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.992318] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 74eea6ac-c14d-4183-bd19-a7637291c933 not found, creating... [ 1016.992606] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.992799] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.993327] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.993402] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.993559] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.993906] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.994269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.994568] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.995982] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.996279] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.996680] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 74eea6ac-c14d-4183-bd19-a7637291c933 is going to be created. [ 1017.021171] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.021393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.021542] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.021863] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.022203] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.022501] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.281703] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.281703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.281703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.281703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.281703] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.281703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.281703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.282082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.282082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.282238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.282515] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.282748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.282884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.283236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.283543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.284016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.284108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.284318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.284401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.284497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.284591] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.441042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.441042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.441042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.441042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.441042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.441042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.441752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.441752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.441752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.441752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.441752] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1017.483517] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.483704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.483752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.484065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.484331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.495644] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1017.787677] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 592028fe-37eb-48a6-a8fb-40903e1d58d4: rpc.has_security_group_logging(os_id): False [ 1017.819549] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.819762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.819832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.820590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.820590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.820590] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.820590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.820590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.820898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.820898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.821671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.821671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.821671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.821671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.821671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.821671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.822221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.822221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.822221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.822221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.822221] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 is going to be created. [ 1017.875654] env[65446]: INFO networking_nsxv3.common.synchronization [req-2e861c6c-cd01-4270-a84e-7a175d37b142 req-1baf3348-572e-4225-87b4-8a43d8d11903 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 1017.875913] env[65446]: INFO networking_nsxv3.common.synchronization [req-2e861c6c-cd01-4270-a84e-7a175d37b142 req-1baf3348-572e-4225-87b4-8a43d8d11903 service nova] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 1017.876096] env[65446]: INFO networking_nsxv3.common.synchronization [req-2e861c6c-cd01-4270-a84e-7a175d37b142 req-1baf3348-572e-4225-87b4-8a43d8d11903 service nova] Enqueued Resource ID: 74eea6ac-c14d-4183-bd19-a7637291c933 with Priority: HIGHEST for action port [ 1017.876874] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_rules [ 1017.876945] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 1017.877048] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74eea6ac-c14d-4183-bd19-a7637291c933 with Priority: HIGHEST for action port [ 1017.877521] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.877622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.877622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.877844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.877970] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.879041] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.879142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.879385] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-74eea6ac-c14d-4183-bd19-a7637291c933 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.879495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.879589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.879814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.879912] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74eea6ac-c14d-4183-bd19-a7637291c933',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.929647] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.929795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.929871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.930109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.930310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.945402] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 in Status: IN_PROGRESS for 2s [ 1018.381832] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.381980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.382173] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74eea6ac-c14d-4183-bd19-a7637291c933 with status ACTIVE [ 1018.382346] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.382483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.382572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.383225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.383329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.383509] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.383719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.383813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.384060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.384161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.384609] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.384609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.384609] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.385061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.385061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.385061] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74eea6ac-c14d-4183-bd19-a7637291c933 is going to be updated. [ 1018.411046] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.411309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.411309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.411517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.411712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.411774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74eea6ac-c14d-4183-bd19-a7637291c933" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.480098] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 1018.480098] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 1018.480098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.480098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.480098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.480440] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.480440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.480440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.480587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.480587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.480674] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.554915] env[65446]: INFO networking_nsxv3.common.synchronization [req-842f4c52-2212-4a76-b889-fa568932f94b req-af0c0f00-874d-49d7-8fda-04ee05025bbb tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1018.556044] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1018.557129] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.557313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.557412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.557756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.557930] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.558098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.558197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.558489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.558638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.558738] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.909101] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.909101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.909101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.909101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.909346] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.909346] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.909483] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.910216] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.910374] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.910586] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.912631] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.912631] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.912775] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.912860] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.912957] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.913619] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.934825] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.935192] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.935444] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.935714] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-778" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.936187] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.936585] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.937792] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.937792] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.937792] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77832cf-36c6-472e-88b1-ee6c1eba1b8f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.983277] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.062713] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.063099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.063357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.064013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.064013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.064315] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.064523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.064650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.064918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.065084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.065237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 1019.093580] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.093896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.093896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.094098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.094254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.105831] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 1019.440543] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.440814] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.440899] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.441215] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.441367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.441525] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port e77832cf-36c6-472e-88b1-ee6c1eba1b8f not found, creating... [ 1019.441792] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.441955] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.442085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.442303] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.442439] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.442718] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.442874] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.442991] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.443213] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.443347] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.443486] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: e77832cf-36c6-472e-88b1-ee6c1eba1b8f is going to be created. [ 1019.465323] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.465598] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.465706] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.465990] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.466255] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.466600] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.485967] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.507813] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1019.507813] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1019.507813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.852168] env[65446]: INFO networking_nsxv3.common.synchronization [req-54a603ee-b659-416b-a623-e2a3b725dfd9 req-2d412197-c6be-4990-8e22-9ad1bcde74c2 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1019.852168] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1019.852168] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.852168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.852168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.852168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.852168] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.852168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.852524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.852788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.853022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.853272] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.959511] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 in Status: SUCCESS [ 1019.959803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.989285] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.989668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.989668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.989915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.990082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.990255] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 1020.025078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.025228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.025304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.025597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.025802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.039144] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 1020.229153] env[65446]: INFO networking_nsxv3.common.synchronization [req-842f4c52-2212-4a76-b889-fa568932f94b req-9b5aa276-53f4-4e5d-945c-3f983ea84340 service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 1020.229153] env[65446]: INFO networking_nsxv3.common.synchronization [req-842f4c52-2212-4a76-b889-fa568932f94b req-9b5aa276-53f4-4e5d-945c-3f983ea84340 service nova] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1020.230240] env[65446]: INFO networking_nsxv3.common.synchronization [req-842f4c52-2212-4a76-b889-fa568932f94b req-9b5aa276-53f4-4e5d-945c-3f983ea84340 service nova] Enqueued Resource ID: e77832cf-36c6-472e-88b1-ee6c1eba1b8f with Priority: HIGHEST for action port [ 1020.230795] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_rules [ 1020.230945] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1020.231363] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e77832cf-36c6-472e-88b1-ee6c1eba1b8f with Priority: HIGHEST for action port [ 1020.231650] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.231793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.231861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.232086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.232181] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.234029] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.234223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.234387] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.234495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.234563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.234809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.234907] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77832cf-36c6-472e-88b1-ee6c1eba1b8f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.355195] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.734580] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.734713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.736458] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e77832cf-36c6-472e-88b1-ee6c1eba1b8f with status ACTIVE [ 1020.736674] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.736821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.737192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.737272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.737466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.737634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.737692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.737776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.737948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.738090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.738293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.738399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.738488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.738697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.738796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.739428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e77832cf-36c6-472e-88b1-ee6c1eba1b8f is going to be updated. [ 1020.761966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.762156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.762314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.762522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.762990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.762990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e77832cf-36c6-472e-88b1-ee6c1eba1b8f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.858258] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.118689] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 1021.118984] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 deletion is rescheduled due to dependency. [ 1021.119046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.119237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.119456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.119661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.119793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.119857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.120065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.120239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.120307] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.362405] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.362405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.362405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.362405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.362405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.362405] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1021.397335] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.397630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.397630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.398916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.399119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.413434] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1021.489217] env[65446]: INFO networking_nsxv3.common.synchronization [req-5ec483a6-4e5b-49fc-8aad-57052b25edb1 req-ee653e37-d468-49a7-91f4-a82d84d57f6b tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_members [ 1021.489854] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_members [ 1021.490418] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.490617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.490699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.490980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.491234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.491399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.491399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.491678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.491760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.491904] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.624267] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.914341] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.914548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.914671] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.915031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.915297] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.915464] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.915580] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.915796] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.915939] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.916342] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.916507] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.916629] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.916740] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.917897] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.919461] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.919622] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.945328] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.945513] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.945686] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.945918] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.946213] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-3b374857-021e-4646-888d-d54867443a47 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.946405] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.946505] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.946818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.946958] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b374857-021e-4646-888d-d54867443a47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.999731] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.999731] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.999731] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 already deleted. [ 1021.999731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.050435] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 1022.050704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.050907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.051334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.051552] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.051683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.051769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.051929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.052054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.052156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.052329] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.128545] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.451820] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.452095] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.452235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.452623] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.454170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.454170] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 3b374857-021e-4646-888d-d54867443a47 not found, creating... [ 1022.454170] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.454170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.454170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.454170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.454170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.454723] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.456550] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.456550] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.456550] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.456550] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.456550] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 3b374857-021e-4646-888d-d54867443a47 is going to be created. [ 1022.479501] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.479501] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.479501] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.479501] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.479827] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.479864] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.555054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.555275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.555275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.555551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.555673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.555801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.555884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.556588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.556588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.556588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.556588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.556588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.556588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.557027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.557027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.557027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.557157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.557221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.557261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.557382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.557484] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.631187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.631366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.631440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.631691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.631786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.631885] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 1022.707289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.707434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.707559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.707779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.707932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.724097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 1023.060190] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184: rpc.has_security_group_logging(os_id): False [ 1023.081760] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.082267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.082493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.082882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.083097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.083416] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.084050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.084050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.084050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.084050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.084289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.084394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.084567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.084771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.084926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.085264] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.085490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.085744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.086093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.086256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.086426] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 1023.159022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.159433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.159433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.159504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.159944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.174250] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 1023.249178] env[65446]: INFO networking_nsxv3.common.synchronization [req-5ec483a6-4e5b-49fc-8aad-57052b25edb1 req-7b83ec2e-d232-469c-bd4a-c98f5a471a4e service nova] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_rules [ 1023.250197] env[65446]: INFO networking_nsxv3.common.synchronization [req-5ec483a6-4e5b-49fc-8aad-57052b25edb1 req-7b83ec2e-d232-469c-bd4a-c98f5a471a4e service nova] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_members [ 1023.250197] env[65446]: INFO networking_nsxv3.common.synchronization [req-5ec483a6-4e5b-49fc-8aad-57052b25edb1 req-7b83ec2e-d232-469c-bd4a-c98f5a471a4e service nova] Enqueued Resource ID: 3b374857-021e-4646-888d-d54867443a47 with Priority: HIGHEST for action port [ 1023.250197] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_rules [ 1023.251066] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_members [ 1023.251248] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b374857-021e-4646-888d-d54867443a47 with Priority: HIGHEST for action port [ 1023.251673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.251761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.251827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.252086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.252190] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.253444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.254453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.254453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.254453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.254453] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.254453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.254453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.254722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.254722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.254722] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.258478] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b374857-021e-4646-888d-d54867443a47 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.258478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.258478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.258478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.258478] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b374857-021e-4646-888d-d54867443a47',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.425031] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1023.425264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.758865] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.759093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.759264] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.760437] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b374857-021e-4646-888d-d54867443a47 with status ACTIVE [ 1023.760587] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.760697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.760760] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.760995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.761218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.761331] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.762557] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.762557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.762557] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b374857-021e-4646-888d-d54867443a47 is going to be updated. [ 1023.787848] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.788095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.788095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.788299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.788456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.788644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b374857-021e-4646-888d-d54867443a47" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.264440] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.705027] env[65446]: INFO networking_nsxv3.common.synchronization [req-7ec4c650-3331-4d27-ba15-bc716317b2cb req-def91fa7-a3d9-4812-a070-c5aca88fd590 tempest-ServersTestBootFromVolume-2126361038 tempest-ServersTestBootFromVolume-2126361038-project-member] Enqueued Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_members [ 1024.705027] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGHEST for action security_group_members [ 1024.705192] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.705369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.705467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.705728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.706223] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.706540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.707090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.708500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.711185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.711307] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.735890] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 1024.736121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.736274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.736488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.736676] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.736788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.736850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.736994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.738968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.738968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.738968] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.766855] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.767056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.767107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.767312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.767401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.767501] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 is going to be created. [ 1024.793724] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.793874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.793945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.794167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.794350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.808410] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: UNINITIALIZED for 2s [ 1025.188530] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 1025.190118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.215784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.215784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.215784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.215784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.238754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.239851] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.239851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.239851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.239851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.239851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.239851] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 is going to be updated. [ 1025.240673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.240795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.240837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.241017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.242199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.243306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.243470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.243804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.243939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.244086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.244292] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.245040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.245040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.245040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.245040] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.245040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.245263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.245405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.245523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.245722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.245872] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.285828] env[65446]: INFO networking_nsxv3.common.synchronization [req-4dc1a4f9-021d-4e9a-a2cf-a62336cda950 req-044d4322-efaa-4f67-ac45-346fe5d4a491 tempest-TenantUsagesTestJSON-1701440320 tempest-TenantUsagesTestJSON-1701440320-project-member] Enqueued Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_members [ 1025.286744] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGHEST for action security_group_members [ 1025.287312] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.287536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.287690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.287935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.288213] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.288434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.288544] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.288747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.288880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.289032] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.291733] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.291733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.291733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.291733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.291733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.305673] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 in Status: IN_PROGRESS for 2s [ 1025.748276] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857e4e4f-84a2-43c7-870d-f3776015cb13: rpc.has_security_group_logging(os_id): False [ 1025.767192] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.767361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.767449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.767725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.767815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.768027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.768134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.768209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.768361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.768440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.768638] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.768733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.768795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.768933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.769015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.769212] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.769311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.769374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.769512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.769586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.769670] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 1025.795086] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.795257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.795330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.795567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.795641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.795828] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.795944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.796024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.796177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.796257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.796358] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 is going to be updated. [ 1025.829102] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.829308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.829434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.829705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.829934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.838699] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.838883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.838941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.839156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.839382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.843847] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 in Status: IN_PROGRESS for 2s [ 1025.855364] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 1026.821473] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: SUCCESS [ 1026.822120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.822342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.822577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.822786] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.822917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.822974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.823185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.823242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.823334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.823409] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.317369] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 in Status: SUCCESS [ 1027.317620] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 deletion is rescheduled due to dependency. [ 1027.317742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.325375] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.827927] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b204e3ce-656a-4d7b-b6f4-7be71e79fd20: rpc.has_security_group_logging(os_id): False [ 1027.857719] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.857719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.857719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.857948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.858532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.858532] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.858532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.858532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.858842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.858842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.858842] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 is going to be created. [ 1027.861854] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 in Status: SUCCESS [ 1027.862056] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 deletion is rescheduled due to dependency. [ 1027.862144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.873340] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 1027.873605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.927899] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.928218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.928308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.928554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.928763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.941977] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: IN_PROGRESS for 2s [ 1028.053074] env[65446]: INFO networking_nsxv3.common.synchronization [req-e7f9d638-a912-4e78-a846-ae97e8a70213 req-ce505da2-42a0-439a-89ba-4f9677e6b830 tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1028.053659] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1028.054251] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.054251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.054251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.054462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.054554] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.054716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.054758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.054950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.055056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.055196] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.448046] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.448336] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.448544] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.449378] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.449694] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.450538] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.450623] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.450870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.451037] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.451446] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.451590] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.451722] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.451838] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.452064] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.452219] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.452452] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.476153] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.476338] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1028.476878] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.476878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.477010] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.477142] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.477446] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.477597] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.478360] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0818a8d7-7a81-4e77-bd12-f5e07ca585a1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.557557] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.557914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.557914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.558183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.558291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.558518] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.558631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.558686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.559126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.559126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.559126] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1028.592706] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.592932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.592932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.593137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.593276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.603209] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1028.980401] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.980709] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.980709] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.981760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.981760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.981760] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 0818a8d7-7a81-4e77-bd12-f5e07ca585a1 not found, creating... [ 1028.981760] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.982019] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.982061] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.982271] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.982410] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.982695] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.982887] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.983040] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.983752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.983752] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.983752] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 0818a8d7-7a81-4e77-bd12-f5e07ca585a1 is going to be created. [ 1029.004936] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.005180] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.005307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.005670] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.005900] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.006150] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.715543] env[65446]: INFO networking_nsxv3.common.synchronization [req-e7f9d638-a912-4e78-a846-ae97e8a70213 req-19acb77f-e87b-465b-a90c-ff580877ab79 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1029.715781] env[65446]: INFO networking_nsxv3.common.synchronization [req-e7f9d638-a912-4e78-a846-ae97e8a70213 req-19acb77f-e87b-465b-a90c-ff580877ab79 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1029.715961] env[65446]: INFO networking_nsxv3.common.synchronization [req-e7f9d638-a912-4e78-a846-ae97e8a70213 req-19acb77f-e87b-465b-a90c-ff580877ab79 service nova] Enqueued Resource ID: 0818a8d7-7a81-4e77-bd12-f5e07ca585a1 with Priority: HIGHEST for action port [ 1029.716516] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1029.716667] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1029.716814] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0818a8d7-7a81-4e77-bd12-f5e07ca585a1 with Priority: HIGHEST for action port [ 1029.717134] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.717265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.717331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.717558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.717671] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.718550] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.718711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.718881] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.718995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.719069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.719263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.719532] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0818a8d7-7a81-4e77-bd12-f5e07ca585a1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.954256] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: SUCCESS [ 1029.954523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.221936] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.222312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.223367] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0818a8d7-7a81-4e77-bd12-f5e07ca585a1 with status ACTIVE [ 1030.223552] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.223668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.223738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.223951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.224058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.224248] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.224348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.224409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.224556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.224635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.224814] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.225074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.225074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.225192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.225192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.225263] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0818a8d7-7a81-4e77-bd12-f5e07ca585a1 is going to be updated. [ 1030.248025] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.248163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.248312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.248631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.248631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.248952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0818a8d7-7a81-4e77-bd12-f5e07ca585a1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.613083] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1030.613306] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1030.613439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.613636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.613859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.614110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.614194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.614252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.614445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.614583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.614583] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.117574] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.622036] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.123946] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.124350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.124869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.125161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.125579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.125579] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1032.161200] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.161408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.161490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.161701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.161846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.172839] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1034.186277] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1034.186650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.186775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.187025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.187264] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.187395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.187461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.187629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.188089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.188089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.188089] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.690386] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.690628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.690734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.691116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.691469] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.691469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.691688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.691688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.691794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.691844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.692126] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.692257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.692316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.692424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.692565] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.692654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.692706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.692843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.692918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.692997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.693117] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.718116] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1034.718214] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1035.195759] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71307925-e0d7-49c9-8bc8-5c5e870d7bca: rpc.has_security_group_logging(os_id): False [ 1035.214699] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.214863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.214924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.215231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.215348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.215546] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.215694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.215837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.215889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.215929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.216141] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.216269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.216329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.216431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.216502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.216696] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.216792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.216847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.216983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.217070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.217156] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1035.279643] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.279803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.279851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.280080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.280262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.292509] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1037.310184] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1037.310547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.604414] env[65446]: INFO networking_nsxv3.common.synchronization [req-a9ac7767-b979-4fd2-87ee-cea5508db2e7 req-13aeb714-6a5b-471e-9d77-97675610c827 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1039.604693] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1039.604986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.605132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.605214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.605454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.605633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.605766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.605855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.606074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.606152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.606265] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.109985] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.614070] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.615713] env[65446]: INFO networking_nsxv3.common.synchronization [req-ed7fc1ea-956b-4745-9bd7-c3de94501a6d req-55de8771-e7f6-4601-97f2-c288537e11bb tempest-ImagesTestJSON-827827192 tempest-ImagesTestJSON-827827192-project-member] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1040.615842] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGHEST for action security_group_members [ 1040.616149] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.616273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.616338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.616616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.616699] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.616794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.616845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.617030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.617087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.617170] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.119315] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.119315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.119315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.119315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.119315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.119315] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1041.120219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.120342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.120418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.120618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.120700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.120912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.121024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.121091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.121246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.121315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.121471] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be updated. [ 1041.170402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.170402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.170402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.184194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.184194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.184194] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.184194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.184194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.184194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.184194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.197280] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: IN_PROGRESS for 2s [ 1041.198219] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1043.082706] env[65446]: INFO networking_nsxv3.common.synchronization [None req-886e609a-4085-48a9-b703-8c68ced7b337 None None] Enqueued Resource ID: 55fbec06-e3cc-4fd3-8c22-1bacf96629da with Priority: HIGHEST for action port [ 1043.083569] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbec06-e3cc-4fd3-8c22-1bacf96629da with Priority: HIGHEST for action port [ 1043.083896] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-55fbec06-e3cc-4fd3-8c22-1bacf96629da taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.085095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55fbec06-e3cc-4fd3-8c22-1bacf96629da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.085688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55fbec06-e3cc-4fd3-8c22-1bacf96629da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.085852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55fbec06-e3cc-4fd3-8c22-1bacf96629da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.085953] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55fbec06-e3cc-4fd3-8c22-1bacf96629da',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.209461] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 in Status: SUCCESS [ 1043.209799] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 deletion is rescheduled due to dependency. [ 1043.212413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.212413] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1043.213012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.571152] env[65446]: INFO networking_nsxv3.common.synchronization [None req-f3a52d5a-9171-486a-9f26-460cd5df80e4 tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1043.571900] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1043.574360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.574360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.574360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.574360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.574360] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.587732] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55fbec06-e3cc-4fd3-8c22-1bacf96629da [ 1043.588479] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.588479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.588479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.588479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.588479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.589095] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55fbec06-e3cc-4fd3-8c22-1bacf96629da already deleted. [ 1043.589095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55fbec06-e3cc-4fd3-8c22-1bacf96629da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.687536] env[65446]: INFO networking_nsxv3.common.synchronization [None req-92e4d03c-b92a-495f-9edc-8f04c1aabcd2 tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1043.688320] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1043.688970] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.689135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.100021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.100021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.100021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.100021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.100021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.100021] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 already deleted. [ 1044.100021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.100021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.100021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.100021] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.623803] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.626169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.626169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.626169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.626169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.626169] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 already deleted. [ 1044.626169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.884273] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c74e772b-159e-408e-83f8-45910cfe77d2 None None] Enqueued Resource ID: 8340da6c-ebcf-44c1-a663-1dd02c496180 with Priority: HIGHEST for action port [ 1045.884273] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8340da6c-ebcf-44c1-a663-1dd02c496180 with Priority: HIGHEST for action port [ 1045.884273] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8340da6c-ebcf-44c1-a663-1dd02c496180 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.884886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8340da6c-ebcf-44c1-a663-1dd02c496180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.884886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8340da6c-ebcf-44c1-a663-1dd02c496180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.884886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8340da6c-ebcf-44c1-a663-1dd02c496180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.884886] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8340da6c-ebcf-44c1-a663-1dd02c496180',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.386915] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8340da6c-ebcf-44c1-a663-1dd02c496180 [ 1046.387503] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.388601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.388601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.388601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.388601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.388601] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8340da6c-ebcf-44c1-a663-1dd02c496180 already deleted. [ 1046.388601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8340da6c-ebcf-44c1-a663-1dd02c496180" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.882027] env[65446]: INFO networking_nsxv3.common.synchronization [None req-7e215116-3d83-43bb-9759-8f8f644e540e None None] Enqueued Resource ID: 0a95ca50-dc25-4039-a57f-404cd7800f3e with Priority: HIGHEST for action port [ 1046.882172] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a95ca50-dc25-4039-a57f-404cd7800f3e with Priority: HIGHEST for action port [ 1046.882990] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a95ca50-dc25-4039-a57f-404cd7800f3e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.882990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a95ca50-dc25-4039-a57f-404cd7800f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.882990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a95ca50-dc25-4039-a57f-404cd7800f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.883260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a95ca50-dc25-4039-a57f-404cd7800f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.883260] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a95ca50-dc25-4039-a57f-404cd7800f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.995787] env[65446]: INFO networking_nsxv3.common.synchronization [req-50a71ac1-22c8-449c-bf5a-43c18510c427 req-18cfa15f-7fbf-49bc-b845-ea98e4dac729 tempest-ServersTestJSON-1390728580 tempest-ServersTestJSON-1390728580-project-member] Enqueued Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_members [ 1046.997029] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGHEST for action security_group_members [ 1046.997482] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.997657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.997757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.998022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.998197] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.998296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.998357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.998505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.998586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.998677] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.385562] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a95ca50-dc25-4039-a57f-404cd7800f3e [ 1047.385849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.386017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.386098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.386321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.386413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.386510] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a95ca50-dc25-4039-a57f-404cd7800f3e already deleted. [ 1047.386593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a95ca50-dc25-4039-a57f-404cd7800f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.501416] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.501416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.501416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.501416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.527020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.527340] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.527457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.527543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.527743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.527819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.528300] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 is going to be updated. [ 1047.558116] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.558261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.558322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.558519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.558654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.569796] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 in Status: IN_PROGRESS for 2s [ 1049.581194] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 in Status: SUCCESS [ 1049.581498] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 deletion is rescheduled due to dependency. [ 1049.581677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.998722] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1051.999080] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1053.846810] env[65446]: INFO networking_nsxv3.common.synchronization [req-60f3906a-6069-4951-9604-68b0dcc8df98 req-72382494-8b90-4c20-aaf7-834f8eb527ec tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1053.847685] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1053.847685] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.847926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.847926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.848052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.848192] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.848294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.848379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.848536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.848667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.848766] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.351942] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.352176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.352249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.352406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.352495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.352687] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.352784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.352846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.352990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.353084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.353165] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1054.403607] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.403812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.403868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.404369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.404577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.425349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1055.503341] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.503911] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.503911] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.503987] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.504292] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.504473] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.504729] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.504865] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.505024] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.505239] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.505523] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.505523] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.505637] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.509049] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.509049] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.509049] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.528496] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.528705] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.528952] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.529682] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-66" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.530172] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-c79021b8-f526-42e3-a71b-2ef1136f2c89 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.530396] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.530396] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.530718] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.530912] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c79021b8-f526-42e3-a71b-2ef1136f2c89',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.033571] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.034030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.034030] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.034396] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.034491] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.034779] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.034936] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.035070] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.035275] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.035439] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.035718] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.035933] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.036014] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.036194] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.036322] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.036462] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 is going to be updated. [ 1056.061841] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.062048] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.062161] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.062424] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.062907] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.062907] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.440661] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1056.441031] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1056.441137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.673858] env[65446]: INFO networking_nsxv3.common.synchronization [None req-87be243a-9cab-405e-89b6-dac680498ad3 None None] Enqueued Resource ID: 3a98368d-696c-4750-8b8b-55379879053d with Priority: HIGHEST for action port [ 1056.674794] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a98368d-696c-4750-8b8b-55379879053d with Priority: HIGHEST for action port [ 1056.675284] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a98368d-696c-4750-8b8b-55379879053d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.675510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a98368d-696c-4750-8b8b-55379879053d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.675583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a98368d-696c-4750-8b8b-55379879053d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.676165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a98368d-696c-4750-8b8b-55379879053d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.676262] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a98368d-696c-4750-8b8b-55379879053d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.791830] env[65446]: INFO networking_nsxv3.common.synchronization [req-b763a929-ed85-4ed9-bd68-0a430dac3252 req-55f6bf23-62f1-4008-bb97-c5e82850e582 service nova] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_rules [ 1056.792057] env[65446]: INFO networking_nsxv3.common.synchronization [req-b763a929-ed85-4ed9-bd68-0a430dac3252 req-55f6bf23-62f1-4008-bb97-c5e82850e582 service nova] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 1056.792290] env[65446]: INFO networking_nsxv3.common.synchronization [req-b763a929-ed85-4ed9-bd68-0a430dac3252 req-55f6bf23-62f1-4008-bb97-c5e82850e582 service nova] Enqueued Resource ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 with Priority: HIGHEST for action port [ 1056.792708] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_rules [ 1056.792844] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 1056.792940] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 with Priority: HIGHEST for action port [ 1056.793218] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.793458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.793458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.793853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.793853] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.794652] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.794652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.794790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.794949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.795206] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.795206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.795206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.795348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.795447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.795527] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.798537] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c79021b8-f526-42e3-a71b-2ef1136f2c89 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.798658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.798724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.799741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.799741] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c79021b8-f526-42e3-a71b-2ef1136f2c89',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.179496] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a98368d-696c-4750-8b8b-55379879053d [ 1057.180231] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.180231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.180231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.180470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.180523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.180795] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a98368d-696c-4750-8b8b-55379879053d already deleted. [ 1057.180795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a98368d-696c-4750-8b8b-55379879053d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.302444] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.302672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.303572] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.303728] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c79021b8-f526-42e3-a71b-2ef1136f2c89 with status ACTIVE [ 1057.303892] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.304016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.304099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.304746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.304746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.304746] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.304746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.304746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.305148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.305148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.305148] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.305418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.305418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.305418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.305624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.305624] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c79021b8-f526-42e3-a71b-2ef1136f2c89 is going to be updated. [ 1057.341649] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.341822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.341877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.342133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.342224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.342373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c79021b8-f526-42e3-a71b-2ef1136f2c89" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.809277] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.314350] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.314350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.314350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.314350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.314350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.314350] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 1058.349310] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.351667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.351667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.351667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.351667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.361840] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 1058.856669] env[65446]: INFO networking_nsxv3.common.synchronization [req-731d1fd4-1c31-46eb-ab35-d9cc24b1bf17 req-03348b30-2f7c-4050-92e9-5fa27ac3762a tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1058.857562] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1058.857819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.857946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.858039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.858316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.858481] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.858586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.858657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.858806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.858900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.858984] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.899103] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d421f3bf-8bc6-4204-85e8-c915c22c0cca None None] Enqueued Resource ID: cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18 with Priority: HIGHEST for action port [ 1058.899103] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18 with Priority: HIGHEST for action port [ 1058.899354] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.899471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.899584] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.899785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.899866] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.190909] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.191169] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.191264] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.191570] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.191825] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.191980] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.192280] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.192508] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.192673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.192889] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.193103] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.193248] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.193386] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.193464] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.193570] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.193990] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.216136] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.216407] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.216621] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.217196] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.217196] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-99574912-3c6e-47de-807f-9c9dfbeec9ab taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.217425] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.217527] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.217837] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.217979] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99574912-3c6e-47de-807f-9c9dfbeec9ab',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.361549] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.361549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.361549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.361840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.361840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.361986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.362147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.362147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.362302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.362377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.362501] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 already deleted. [ 1059.362554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.402172] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18 [ 1059.402468] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.402619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.402678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.402854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.402941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.403047] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18 already deleted. [ 1059.403132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc62ec4f-fd94-4f54-82f6-a7f7b89e8a18" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.720956] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.721162] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.721314] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.721582] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.722103] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.722103] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 99574912-3c6e-47de-807f-9c9dfbeec9ab not found, creating... [ 1059.722247] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.722365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.722490] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.722703] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.722839] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.723180] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.723459] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.723532] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.723850] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.723982] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.724134] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 99574912-3c6e-47de-807f-9c9dfbeec9ab is going to be created. [ 1059.745577] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.745764] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.745936] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.746306] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.746567] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.746879] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.373096] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 1060.373478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.373594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.373821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.374057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.374189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.374258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.374431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.374513] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.374601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.374691] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.450237] env[65446]: INFO networking_nsxv3.common.synchronization [req-731d1fd4-1c31-46eb-ab35-d9cc24b1bf17 req-ae9f5deb-96e9-4d78-bd5b-54b739b0c659 service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1060.450415] env[65446]: INFO networking_nsxv3.common.synchronization [req-731d1fd4-1c31-46eb-ab35-d9cc24b1bf17 req-ae9f5deb-96e9-4d78-bd5b-54b739b0c659 service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1060.450552] env[65446]: INFO networking_nsxv3.common.synchronization [req-731d1fd4-1c31-46eb-ab35-d9cc24b1bf17 req-ae9f5deb-96e9-4d78-bd5b-54b739b0c659 service nova] Enqueued Resource ID: 99574912-3c6e-47de-807f-9c9dfbeec9ab with Priority: HIGHEST for action port [ 1060.451300] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1060.451437] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1060.451535] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99574912-3c6e-47de-807f-9c9dfbeec9ab with Priority: HIGHEST for action port [ 1060.451889] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.451984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.451984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.452219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.452286] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.453426] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.453558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.453608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.453758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.453935] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.453985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.454070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.454198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.454282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.454371] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.455178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-99574912-3c6e-47de-807f-9c9dfbeec9ab taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.455307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.455375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.455732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.455732] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99574912-3c6e-47de-807f-9c9dfbeec9ab',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.876980] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.877305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.877396] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.877683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.877926] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.878069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.878214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.878382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.878478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.878570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.878748] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.878868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.878933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.879092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.879770] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.879770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.879770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.879770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.879770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.879770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.879770] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.957488] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.957640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.957795] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99574912-3c6e-47de-807f-9c9dfbeec9ab with status ACTIVE [ 1060.957959] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.958078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.958135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.958423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.958536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.958683] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.958783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.958841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.958977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.959137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.959250] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.959346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.959443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.959542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.959615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.959782] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99574912-3c6e-47de-807f-9c9dfbeec9ab is going to be updated. [ 1060.960850] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.985710] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.985912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.985912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.986173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.986322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.986487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99574912-3c6e-47de-807f-9c9dfbeec9ab" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.384028] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a035b80c-7bce-4315-917c-4962056ba63f: rpc.has_security_group_logging(os_id): False [ 1061.403266] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.403458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.403560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.403822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.425321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.425591] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.425711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.425780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.425978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.426075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.426271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.426413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.426510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.426731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.426854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.427147] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.427299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.427410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.427595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.427679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.427770] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 1061.463884] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.495350] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.495617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.495617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.495889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.496144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.509415] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 1061.966917] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.967125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.967202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.967419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.967509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.967782] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be created. [ 1061.992147] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.992390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.992390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.992574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.992734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.004451] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: UNINITIALIZED for 2s [ 1063.525340] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 1063.525340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.020113] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.020113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.020113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.020113] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.522467] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.025913] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1358f1df-64ea-4b5e-909f-92bef5099bf1: rpc.has_security_group_logging(os_id): False [ 1065.053271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.053271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.053271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.053271] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be created. [ 1065.124772] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.124948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.124996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.125230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.125495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.144664] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1065.452954] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1065.454211] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1066.511717] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.512131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.512131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.512330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.512487] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.519329] env[65446]: INFO networking_nsxv3.common.synchronization [req-aff2f85d-c121-47da-9e94-eea503163440 req-c33bdfba-bec2-46f7-8ff9-8a735d9d9824 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1066.519329] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1066.519329] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.519329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.519329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.519329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.519329] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.520669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.520669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.520669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.520669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.520669] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.859073] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.859073] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.859073] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.859350] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.859518] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.859682] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.859837] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.860223] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.860395] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.860646] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1066.860757] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.860866] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.860977] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.861107] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1066.861216] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.861353] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.881073] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.881316] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1066.881472] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.881753] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.881972] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.882268] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.882340] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.882594] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.882732] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.015590] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.023661] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.158852] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1067.159337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.387123] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.387123] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.387444] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.387520] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.387680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.387845] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d not found, creating... [ 1067.388192] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.388447] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.388582] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.388814] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.388956] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.389342] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.389553] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.389678] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.389896] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.390049] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.390197] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d is going to be created. [ 1067.413819] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.414106] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.414196] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.414485] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.414800] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.415075] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.519148] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.526557] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.961335] env[65446]: INFO networking_nsxv3.common.synchronization [req-d4ea170b-076e-4623-bd79-9cce7beb9fe8 req-53e2e2ba-1851-4d08-89b2-ebf00462112a tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_members [ 1067.961945] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGHEST for action security_group_members [ 1067.962461] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.962461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.962461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.962701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.963040] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.963040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.963040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.963040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.963208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.963208] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.020515] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1068.020699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1068.029514] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.030441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.030441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.030441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.030441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.030441] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1068.077305] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.077525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.077525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.077730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.078118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.090548] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1068.148579] env[65446]: INFO networking_nsxv3.common.synchronization [req-aff2f85d-c121-47da-9e94-eea503163440 req-72ca9f82-b789-4274-85ea-25670d6581bb service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 1068.149262] env[65446]: INFO networking_nsxv3.common.synchronization [req-aff2f85d-c121-47da-9e94-eea503163440 req-72ca9f82-b789-4274-85ea-25670d6581bb service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1068.149452] env[65446]: INFO networking_nsxv3.common.synchronization [req-aff2f85d-c121-47da-9e94-eea503163440 req-72ca9f82-b789-4274-85ea-25670d6581bb service nova] Enqueued Resource ID: b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d with Priority: HIGHEST for action port [ 1068.150322] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 1068.150473] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1068.150670] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d with Priority: HIGHEST for action port [ 1068.151361] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.151361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.151521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.152068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.152068] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.153205] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.153360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.153506] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.153641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.153719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.156750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.156750] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.465620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.465620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.465620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.466086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.494959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.494959] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.494959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.494959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.494959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.494959] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.494959] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 is going to be updated. [ 1068.522472] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.522780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.522827] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.523188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.523321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.533714] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3eac718-710e-4e9f-8192-af1a5cf67174 in Status: IN_PROGRESS for 2s [ 1068.657318] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.657614] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.657917] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d with status ACTIVE [ 1068.658740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.658740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.658740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.658997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.658997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.659272] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.659504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.659611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.659950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.660154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.660505] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.660700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.660778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.661684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.661684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.661684] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d is going to be updated. [ 1068.693164] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.693400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.693400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.693608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.693831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.693901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b97a2ea5-ffa2-4cc1-a83a-6bd416c9177d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.828020] env[65446]: INFO networking_nsxv3.common.synchronization [req-2c3e0113-ae96-4797-81c6-3fc416a7f186 req-716056d1-28c6-45e5-95be-77d9a2c8e3d4 tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1068.828783] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1068.829787] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.829787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.829787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.829787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.830060] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.830060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.830275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.830275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.830379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.830379] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.016050] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.016308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.016308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.016574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.035027] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1069.035948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.037784] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1069.077703] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.077703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.077703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.077703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.088027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.088835] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1069.088943] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1069.089063] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1069.156363] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.156594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.156594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.157238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.158271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.158972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1069.204237] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.204487] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.204577] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.204857] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.205188] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.205365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.205479] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.205833] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.205975] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.206708] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.207414] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.207773] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.207919] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.208018] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.208526] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.209058] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.231239] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.231239] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.231239] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.231239] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.231239] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-5f108fe2-adff-46fa-bef5-c17359238d49 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.231239] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.231239] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.231643] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.231643] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f108fe2-adff-46fa-bef5-c17359238d49',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.282511] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.282865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.282865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.283144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.283684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.284079] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1069.333152] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.333328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.333399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.333602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.402052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.402052] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.402052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.402052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.402052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.402052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.402422] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1069.471032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.471032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.471032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.471032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.471032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.484468] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1069.506185] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.506185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.506185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.506849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.506849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.506958] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1069.507031] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24', '835eaf64-0d37-43cd-8dd2-62f3d793f1b3', '3905b26b-bddd-4c0d-8d21-44f2dd75c139', '583f19d5-b0b1-4a6f-a392-b6a9fd3dd052', '6b40223d-d70d-4f9e-8923-817eac1b52f3', 'b204e3ce-656a-4d7b-b6f4-7be71e79fd20', '103a67fb-9e13-4b72-af0a-1870746747b1', '836e04b1-dc9b-4bf9-99b5-eff0da424604', 'e6972103-6289-4c91-918e-1586283726a6', '592028fe-37eb-48a6-a8fb-40903e1d58d4', '857e4e4f-84a2-43c7-870d-f3776015cb13', 'e3eac718-710e-4e9f-8192-af1a5cf67174', 'a035b80c-7bce-4315-917c-4962056ba63f', '9ae8301c-ec7c-4370-9c48-81411fb3a144', '1a3d84de-849b-4168-a66d-1a888b3d35e1', '55137d38-b725-49e7-b742-3c0e3a6a4801', 'e5b8bdb1-50db-4ff1-a172-37099eae0157', 'e409fe6a-de26-4e4b-88db-48ec1048ff2d', '6ae2085b-a069-4f37-b210-ebb8cf045349', 'bd996317-fb1b-4d07-a8c8-969fa47508ae', '38fd7db5-286a-40dc-8ccd-267d22d38c03', 'df9add5c-c992-43ca-9245-5304b7194290', '7dd34d6e-ba50-47dc-9428-10a867ec77b5', '743ab854-8016-4dd1-b444-e671e7099027', '71307925-e0d7-49c9-8bc8-5c5e870d7bca', '98940883-9fda-4b23-9149-fb7213985597', '2e2374b8-374d-4226-b090-9ede1d4ec196', 'b0365110-9ded-49bd-a10e-2a106e2db350', 'd360f67e-96d2-41e3-87bd-00f87fb4fd70', '4bcaa519-eaf6-4bf5-a9ec-8f1e80048184', '1358f1df-64ea-4b5e-909f-92bef5099bf1', '8b57e5c1-c933-4317-815e-0311cc4e843e', 'a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8', '56ef744e-edae-484b-8821-4f332fd192db', 'ea407653-fe6d-49fc-ae9f-5964f5403512', 'e23716b6-1df0-449b-b54b-5cbfb06165bd', '3e72bae3-70cb-43fb-a5f0-90cde0349d10', 'ef2378e4-6034-4c52-b983-3b0244de565d', 'c643e66c-7f7f-4e0f-8505-d639c9542f3e', '79c30290-ba80-4936-8673-39beeb72a136', '4c822184-f94c-47e7-a37a-4a1a1df93e39', '73f89999-ebe2-4491-b7a9-a88502cfe139', 'a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44'} {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1069.507673] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1069.532787] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.533335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.533335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.533335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.533335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.533491] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1069.533526] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1069.533637] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1069.658203] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.658481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.658542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.658793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.660063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.660544] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1069.660700] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1069.660816] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1069.660904] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1069.660970] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1069.661111] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGH for action security_group_rules [ 1069.661172] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGH for action security_group_rules [ 1069.661319] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGH for action security_group_rules [ 1069.661410] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGH for action security_group_rules [ 1069.661526] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGH for action security_group_rules [ 1069.661658] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGH for action security_group_rules [ 1069.661755] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGH for action security_group_rules [ 1069.661826] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGH for action security_group_rules [ 1069.661890] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGH for action security_group_rules [ 1069.661951] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGH for action security_group_rules [ 1069.662034] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGH for action security_group_rules [ 1069.662097] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGH for action security_group_rules [ 1069.662144] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGH for action security_group_rules [ 1069.662200] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGH for action security_group_rules [ 1069.662253] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGH for action security_group_rules [ 1069.662327] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGH for action security_group_rules [ 1069.662988] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGH for action security_group_rules [ 1069.662988] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGH for action security_group_rules [ 1069.662988] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGH for action security_group_rules [ 1069.662988] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGH for action security_group_rules [ 1069.662988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.735747] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.736083] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.736270] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.736634] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.736852] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.736998] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 5f108fe2-adff-46fa-bef5-c17359238d49 not found, creating... [ 1069.737323] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.737772] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.737772] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.738166] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.738238] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.738568] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.738745] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.738876] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.739081] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.739565] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.739719] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 5f108fe2-adff-46fa-bef5-c17359238d49 is going to be created. [ 1069.767018] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.767274] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.767442] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.767734] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.767964] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.768250] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.105364] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1070.105610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.105856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.106107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.106307] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.106417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.106487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.106714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.106714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.106828] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.499653] env[65446]: INFO networking_nsxv3.common.synchronization [req-2c3e0113-ae96-4797-81c6-3fc416a7f186 req-282f5b8a-a24e-4341-baa5-6c2a8f316efc service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1070.499836] env[65446]: INFO networking_nsxv3.common.synchronization [req-2c3e0113-ae96-4797-81c6-3fc416a7f186 req-282f5b8a-a24e-4341-baa5-6c2a8f316efc service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1070.499973] env[65446]: INFO networking_nsxv3.common.synchronization [req-2c3e0113-ae96-4797-81c6-3fc416a7f186 req-282f5b8a-a24e-4341-baa5-6c2a8f316efc service nova] Enqueued Resource ID: 5f108fe2-adff-46fa-bef5-c17359238d49 with Priority: HIGHEST for action port [ 1070.500485] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1070.500629] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1070.500733] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f108fe2-adff-46fa-bef5-c17359238d49 with Priority: HIGHEST for action port [ 1070.500833] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGH for action security_group_rules [ 1070.500928] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGH for action security_group_rules [ 1070.501032] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103a67fb-9e13-4b72-af0a-1870746747b1 with Priority: HIGH for action security_group_rules [ 1070.501126] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 with Priority: HIGH for action security_group_rules [ 1070.501217] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd996317-fb1b-4d07-a8c8-969fa47508ae with Priority: HIGH for action security_group_rules [ 1070.501351] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 with Priority: HIGH for action security_group_rules [ 1070.501515] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d with Priority: HIGH for action security_group_rules [ 1070.501515] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGH for action security_group_rules [ 1070.501585] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 with Priority: HIGH for action security_group_rules [ 1070.501619] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 with Priority: HIGH for action security_group_rules [ 1070.501700] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGH for action security_group_rules [ 1070.501789] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3eac718-710e-4e9f-8192-af1a5cf67174 with Priority: HIGH for action security_group_rules [ 1070.501864] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 with Priority: HIGH for action security_group_rules [ 1070.501950] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 with Priority: HIGH for action security_group_rules [ 1070.502051] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGH for action security_group_rules [ 1070.502143] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGH for action security_group_rules [ 1070.502230] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 with Priority: HIGH for action security_group_rules [ 1070.502317] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 with Priority: HIGH for action security_group_rules [ 1070.502399] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 with Priority: HIGH for action security_group_rules [ 1070.502482] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 with Priority: HIGH for action security_group_rules [ 1070.502771] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.502887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.502951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.503169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.503247] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.504301] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.505202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.505202] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f108fe2-adff-46fa-bef5-c17359238d49 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.505202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.505202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.505202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.505202] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f108fe2-adff-46fa-bef5-c17359238d49',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.505935] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.505935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.506112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.506155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.506233] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.507033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.507033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.507187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.507225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.507304] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.507985] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103a67fb-9e13-4b72-af0a-1870746747b1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.508098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.508142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.508695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.508695] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103a67fb-9e13-4b72-af0a-1870746747b1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.511234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a3d84de-849b-4168-a66d-1a888b3d35e1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.511234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.511234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.511444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.511444] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a3d84de-849b-4168-a66d-1a888b3d35e1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.512860] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd996317-fb1b-4d07-a8c8-969fa47508ae taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.512860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.512860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.512860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.512860] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd996317-fb1b-4d07-a8c8-969fa47508ae',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.513146] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ae2085b-a069-4f37-b210-ebb8cf045349 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.513859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.513859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.513859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.513859] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ae2085b-a069-4f37-b210-ebb8cf045349',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.514255] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.514362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.514507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.514597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.514698] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e409fe6a-de26-4e4b-88db-48ec1048ff2d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.515573] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.515660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.515886] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ae8301c-ec7c-4370-9c48-81411fb3a144 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.515984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.516073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.516223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.516333] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ae8301c-ec7c-4370-9c48-81411fb3a144',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.516997] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55137d38-b725-49e7-b742-3c0e3a6a4801 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.517109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.517151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.517291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.517364] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55137d38-b725-49e7-b742-3c0e3a6a4801',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.518175] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.518312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.518395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.518561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.518635] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.519397] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3eac718-710e-4e9f-8192-af1a5cf67174 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.519397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.519535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.519635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.519731] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3eac718-710e-4e9f-8192-af1a5cf67174',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.520512] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857e4e4f-84a2-43c7-870d-f3776015cb13 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.520606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.520736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.520818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.520890] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857e4e4f-84a2-43c7-870d-f3776015cb13',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.521562] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-592028fe-37eb-48a6-a8fb-40903e1d58d4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.521651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.521719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.521871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.521939] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('592028fe-37eb-48a6-a8fb-40903e1d58d4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.522620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.522714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.522773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.522919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.522990] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.523795] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.523887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.523951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.524115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.524186] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.524850] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-836e04b1-dc9b-4bf9-99b5-eff0da424604 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.524948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.524993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.525154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.525225] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('836e04b1-dc9b-4bf9-99b5-eff0da424604',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.526224] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b40223d-d70d-4f9e-8923-817eac1b52f3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.526332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.526332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.526465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.526539] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b40223d-d70d-4f9e-8923-817eac1b52f3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.527328] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.527432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.527491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.527634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.527706] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('835eaf64-0d37-43cd-8dd2-62f3d793f1b3',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.528651] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.528716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.528751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.529080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.529080] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583f19d5-b0b1-4a6f-a392-b6a9fd3dd052',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.546381] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3eac718-710e-4e9f-8192-af1a5cf67174 in Status: SUCCESS [ 1070.546381] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 deletion is rescheduled due to dependency. [ 1070.547724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.609683] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.033145] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.033360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.033506] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f108fe2-adff-46fa-bef5-c17359238d49 with status ACTIVE [ 1071.033900] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.034059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.034155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.034392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.034576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.034800] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.034937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.035025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.035178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.035278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.035516] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.035641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.035736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.035916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.035988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.036089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f108fe2-adff-46fa-bef5-c17359238d49 is going to be updated. [ 1071.037913] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.038072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.038123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.038271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.038491] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.038637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.038694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.038865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.038950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.039086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.039191] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.041536] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.041536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.041536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.041764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.042747] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.042747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.042747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.042747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.042747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.042747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.042747] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.043372] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.043724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.043724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.043840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.043975] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.044225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.044339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.044562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.044660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.044789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.044905] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.052614] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.052771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.052848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.053065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.053233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.053331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.053404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.053534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.053907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.053907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.053907] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.061267] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.061267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.061267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.061589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.061627] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.061751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.061804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.061939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.062034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.062108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.062188] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.070989] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.111712] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.119293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.119470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.119470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.119692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.121751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.121885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.122783] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.122906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.123681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.123804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.124579] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.124716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.125413] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.125529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.126357] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.126473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.127207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.127320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.128179] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.128353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.129044] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.129163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.129793] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.129904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.131046] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.131553] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.131641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.132454] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.132713] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.132826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.134131] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.134530] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.134652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.135214] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.135587] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.135735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.135808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.136015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.136158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.136316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f108fe2-adff-46fa-bef5-c17359238d49" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.152059] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.152900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.152900] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 592028fe-37eb-48a6-a8fb-40903e1d58d4 is going to be deleted. [ 1071.153687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.153919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.176930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.177176] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ae2085b-a069-4f37-b210-ebb8cf045349 is going to be deleted. [ 1071.178211] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.178561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.204155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.204255] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e409fe6a-de26-4e4b-88db-48ec1048ff2d is going to be deleted. [ 1071.205188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.205412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.244276] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.244540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.245169] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.245267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.245993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.246236] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 836e04b1-dc9b-4bf9-99b5-eff0da424604 is going to be deleted. [ 1071.247288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.247587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.317986] env[65446]: INFO networking_nsxv3.common.synchronization [req-91371c7f-f775-4ecf-902a-85923ddd5c6e req-3100a4c5-1648-4ed5-bbc9-122ea0e1c689 tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1071.318935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.319070] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857e4e4f-84a2-43c7-870d-f3776015cb13 is going to be deleted. [ 1071.320563] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1071.320841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.321067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.322282] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.322534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.322534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.324225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.324225] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.324225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.324225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.324225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.324225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.324225] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.345924] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.345924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.385906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.386136] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd996317-fb1b-4d07-a8c8-969fa47508ae is going to be deleted. [ 1071.387201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.387518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.441423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.441655] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ae8301c-ec7c-4370-9c48-81411fb3a144 is going to be deleted. [ 1071.443651] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.443651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.443651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.443651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.443651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.444013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-836e04b1-dc9b-4bf9-99b5-eff0da424604" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.444013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.444122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.505819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.505819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.525467] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1071.525467] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1071.525467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.525467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.525467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.525724] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.525724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.525724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.525889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.525979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.526126] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.539798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.540147] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 835eaf64-0d37-43cd-8dd2-62f3d793f1b3 is going to be deleted. [ 1071.541273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.541869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.544133] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.544277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.550295] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.550754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.550754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.550854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.551019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.551130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.551214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.552057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.552057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.552057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.552057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.552057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.552057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.552495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.552495] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.553027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.553027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.553027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.553214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.553214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.553392] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.555147] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.556172] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.556741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.556741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.556741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.556741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.556976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.556976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.557057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.557292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.557292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.557520] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.557520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.557520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.557954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.557954] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.557954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.557954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.558123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.558123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.558189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.558267] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.572539] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.578607] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b204e3ce-656a-4d7b-b6f4-7be71e79fd20: rpc.has_security_group_logging(os_id): False [ 1071.581285] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.581458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.596395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.596617] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a3d84de-849b-4168-a66d-1a888b3d35e1 is going to be deleted. [ 1071.597677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.597912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.615713] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.615934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.616043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.616194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.616336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.616439] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1071.628999] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.629200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.660179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.660286] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b40223d-d70d-4f9e-8923-817eac1b52f3 is going to be deleted. [ 1071.661229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.661469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.726084] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.726676] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.726676] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.727089] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.727531] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.727810] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.728029] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.728889] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.728889] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.728889] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.729180] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.729180] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.729391] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.729590] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.729787] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.730038] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.733679] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.733879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.759745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.759936] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3eac718-710e-4e9f-8192-af1a5cf67174 is going to be deleted. [ 1071.760893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.761105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.803415] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.803714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.803714] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.803924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.804100] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.806206] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.806395] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.076 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.806562] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.806780] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.807418] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.807418] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.807635] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.807813] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.807976] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b147a9d-f1ac-453e-aac0-f5d055e26cbf',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.826672] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.826948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.848666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.848903] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103a67fb-9e13-4b72-af0a-1870746747b1 is going to be deleted. [ 1071.850304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.850582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.872961] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1071.885784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.885784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.935540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.935540] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583f19d5-b0b1-4a6f-a392-b6a9fd3dd052 is going to be deleted. [ 1071.936627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.936895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.937012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.937146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-592028fe-37eb-48a6-a8fb-40903e1d58d4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.938056] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.938212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.938270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.938566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.938706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.938847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3eac718-710e-4e9f-8192-af1a5cf67174" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.938992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.939225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.939294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.939424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ae2085b-a069-4f37-b210-ebb8cf045349" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.940130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.940311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.940420] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.940551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e409fe6a-de26-4e4b-88db-48ec1048ff2d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.940778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.941034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.955923] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.956155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.996077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.996288] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55137d38-b725-49e7-b742-3c0e3a6a4801 is going to be deleted. [ 1071.997596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.997934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.998107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.998309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd996317-fb1b-4d07-a8c8-969fa47508ae" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.999478] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.999637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.999754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.000018] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.000130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.000297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103a67fb-9e13-4b72-af0a-1870746747b1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.000462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.000690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.000797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.000945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ae8301c-ec7c-4370-9c48-81411fb3a144" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.001596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.001807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.029751] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.050682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.050994] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.051131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.051203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.051431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.051520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.051618] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 is going to be updated. [ 1072.052769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.052979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.053108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.053351] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.053459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.053538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.053695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.053773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.053872] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 already deleted. [ 1072.053958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.054118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.054278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.054371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.054585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b40223d-d70d-4f9e-8923-817eac1b52f3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.054851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.055102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.055234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.055400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857e4e4f-84a2-43c7-870d-f3776015cb13" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.055524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.055618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.055723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.055834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a3d84de-849b-4168-a66d-1a888b3d35e1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.056509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.056749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.056839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.056985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-835eaf64-0d37-43cd-8dd2-62f3d793f1b3" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.059791] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a035b80c-7bce-4315-917c-4962056ba63f: rpc.has_security_group_logging(os_id): False [ 1072.061018] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3905b26b-bddd-4c0d-8d21-44f2dd75c139: rpc.has_security_group_logging(os_id): False [ 1072.062114] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24: rpc.has_security_group_logging(os_id): False [ 1072.074650] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6972103-6289-4c91-918e-1586283726a6: rpc.has_security_group_logging(os_id): False [ 1072.098371] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.098719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.098811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.099084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.128592] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.128813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.130884] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.131046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.136555] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.136748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.141964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.142146] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.142250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.142318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.142564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.142655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.142837] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1072.143910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.144198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.146767] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.146936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.181101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.181567] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.181786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.181884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.182357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.182517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.182914] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.183109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.183213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.183478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.183985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.183985] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.184472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.184472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.184472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.184472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.184674] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be updated. [ 1072.186276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.186503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.186640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.186820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583f19d5-b0b1-4a6f-a392-b6a9fd3dd052" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.187045] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.187280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.201526] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.201776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.285747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.286125] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.286267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.286333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.286540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.286643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.287024] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6972103-6289-4c91-918e-1586283726a6 is going to be updated. [ 1072.288063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.288234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.311134] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.311430] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.311584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.311993] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.312233] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.312444] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 3b147a9d-f1ac-453e-aac0-f5d055e26cbf not found, creating... [ 1072.312829] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.313060] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.313244] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.313697] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.313899] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.314318] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.314515] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.314693] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.314998] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.315218] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.315388] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 3b147a9d-f1ac-453e-aac0-f5d055e26cbf is going to be created. [ 1072.319641] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.319873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.375997] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.376262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.380452] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.380876] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.381109] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.381607] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.382023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.382408] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.437573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.437890] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.438037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.438111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.438364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.438536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.438825] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.439029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.439029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.439228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.439311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.439584] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.439681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.439745] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.439903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.439982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.440103] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 1072.441296] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.441482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.441735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.441824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55137d38-b725-49e7-b742-3c0e3a6a4801" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.441976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.442148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.443030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.443405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.443588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.443731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.532657] env[65446]: INFO networking_nsxv3.common.synchronization [req-b880ba59-0aee-4e07-9299-ca22e0485131 req-64d7d88f-ffa4-452e-a5d4-6cda65368f8a tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1072.534111] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.535597] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1072.536477] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.536657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.536716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.537102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.537246] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.537379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.537508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.537769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.537904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.538103] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.563420] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1072.564194] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: IN_PROGRESS for 2s [ 1072.565816] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.566502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.566502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.566502] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.566721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.599853] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 1072.626588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.626824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.626824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.627047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.627209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.653703] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: IN_PROGRESS for 2s [ 1072.754502] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.754730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.754820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.755214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.755648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.788167] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 1072.890234] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.890449] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.890790] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.890882] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.891158] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.891335] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.891436] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.891667] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.892069] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.892069] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.892186] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.892337] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.892403] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.892468] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.892563] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.892694] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.928873] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.929076] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.929231] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.929417] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.929766] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-5220420d-8882-4d81-9481-88a2b0964b8e taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.929938] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.930072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.930427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.930569] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5220420d-8882-4d81-9481-88a2b0964b8e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.035339] env[65446]: INFO networking_nsxv3.common.synchronization [req-91371c7f-f775-4ecf-902a-85923ddd5c6e req-9d9fa2f2-a045-4d73-ace1-ffeeee8e6cf1 service nova] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_rules [ 1073.035565] env[65446]: INFO networking_nsxv3.common.synchronization [req-91371c7f-f775-4ecf-902a-85923ddd5c6e req-9d9fa2f2-a045-4d73-ace1-ffeeee8e6cf1 service nova] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1073.035866] env[65446]: INFO networking_nsxv3.common.synchronization [req-91371c7f-f775-4ecf-902a-85923ddd5c6e req-9d9fa2f2-a045-4d73-ace1-ffeeee8e6cf1 service nova] Enqueued Resource ID: 3b147a9d-f1ac-453e-aac0-f5d055e26cbf with Priority: HIGHEST for action port [ 1073.036573] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_rules [ 1073.036719] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1073.036822] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b147a9d-f1ac-453e-aac0-f5d055e26cbf with Priority: HIGHEST for action port [ 1073.039091] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.039403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.039512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.039736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.039826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.039928] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1073.041244] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.041378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.041425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.041616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.041699] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.042588] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.042698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.042767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.042921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.043078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.043174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.043236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.043374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.043453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.043656] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.044442] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.044766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.044766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.044766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.044907] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b147a9d-f1ac-453e-aac0-f5d055e26cbf',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.048041] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.048217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.048303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.048595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.048709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.048916] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.049086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.049294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.049363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.050185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.050185] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be already deleted. [ 1073.050185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.084515] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.084710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.084710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.084894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.085048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.094592] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1073.433425] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.434299] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.434299] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.434299] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.434299] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.434575] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 5220420d-8882-4d81-9481-88a2b0964b8e not found, creating... [ 1073.434645] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.434893] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.434957] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.435178] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.435314] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.435596] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.435769] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.435890] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.436123] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.436275] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.436425] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 5220420d-8882-4d81-9481-88a2b0964b8e is going to be created. [ 1073.462362] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.462894] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.463080] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.463399] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.463684] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.463971] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.550569] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b147a9d-f1ac-453e-aac0-f5d055e26cbf with status ACTIVE [ 1073.551338] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.551338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.551338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.551639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.551639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.551748] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.551874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.551943] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.552129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.552223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.552412] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.552514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.552577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.552720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.552796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.552882] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b147a9d-f1ac-453e-aac0-f5d055e26cbf is going to be updated. [ 1073.554451] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.554451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.554651] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.576986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.577393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.577393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.577393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.577538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.577686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b147a9d-f1ac-453e-aac0-f5d055e26cbf" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.886686] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1073.886904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.887034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.887283] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.887484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.887607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.887667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.887821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.887900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.887988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.888100] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.059336] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.206691] env[65446]: INFO networking_nsxv3.common.synchronization [req-b880ba59-0aee-4e07-9299-ca22e0485131 req-259e08dd-064b-43ee-ac76-28046afa3752 service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1074.206930] env[65446]: INFO networking_nsxv3.common.synchronization [req-b880ba59-0aee-4e07-9299-ca22e0485131 req-259e08dd-064b-43ee-ac76-28046afa3752 service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1074.207138] env[65446]: INFO networking_nsxv3.common.synchronization [req-b880ba59-0aee-4e07-9299-ca22e0485131 req-259e08dd-064b-43ee-ac76-28046afa3752 service nova] Enqueued Resource ID: 5220420d-8882-4d81-9481-88a2b0964b8e with Priority: HIGHEST for action port [ 1074.207702] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1074.207844] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1074.207942] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5220420d-8882-4d81-9481-88a2b0964b8e with Priority: HIGHEST for action port [ 1074.208239] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.208474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.208570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.208844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.208930] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.209889] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.210046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.210186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.210247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.210425] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.210507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.210546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.210664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.210799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.210926] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.214124] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5220420d-8882-4d81-9481-88a2b0964b8e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.214124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.214124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.214124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.214124] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5220420d-8882-4d81-9481-88a2b0964b8e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.390887] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.391137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.391652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.391652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.391952] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.392167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.392227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.392477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.392646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.392816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.393085] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.393262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.393356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.393607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.393852] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.393998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.394124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.394334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.394449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.394574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.394709] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.563287] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.563781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.563911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.564181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.564319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.564389] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be created. [ 1074.581777] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1074.582040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.582809] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: SUCCESS [ 1074.583147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.596162] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.596409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.597310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.597310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.597310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.610754] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: UNINITIALIZED for 2s [ 1074.615199] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 1074.615260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.664964] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: SUCCESS [ 1074.665978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.715687] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.716934] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.717137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.717342] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5220420d-8882-4d81-9481-88a2b0964b8e with status ACTIVE [ 1074.718031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.718031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.718031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.718031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.718031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.718325] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.718325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.718325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.719706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.719706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.719706] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.719706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.719706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.719706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.719706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.719706] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5220420d-8882-4d81-9481-88a2b0964b8e is going to be updated. [ 1074.740367] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.740576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.740750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.740974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.741590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.741590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5220420d-8882-4d81-9481-88a2b0964b8e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.807397] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 1074.807698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.898461] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 1074.924885] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.925067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.925140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.925390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.929318] env[65446]: INFO networking_nsxv3.common.synchronization [req-8d90d8b1-1948-4a62-9703-e3fab4f81adb req-d103ebf6-0731-4b98-b982-e6a9820c5c2e tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1074.930148] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1074.930581] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.930750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.930865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.931205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.931410] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.931554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.931657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.931887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.932031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.932177] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.951828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.952277] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.952480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.952972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.952972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.953154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.953477] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.953651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.953764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.954028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.954168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.954473] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.954632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.954703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.954890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.954974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.955084] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1075.037358] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.037693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.037693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.037967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.038174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.055715] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1075.104690] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1075.104915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.105112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.105328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.105528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.105642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.105706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.105858] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.105938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.106038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.106134] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.222320] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.362685] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.363015] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-591" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.363244] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-591" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.363743] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-591" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.364174] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.364427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.364632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.364998] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.365258] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.365603] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.365715] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.365867] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.366046] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.366246] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.366495] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.366709] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.393874] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.393874] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.394068] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.394237] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-591" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.394772] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-58285e2b-e6f1-48cb-889c-ad2385869dbb taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.395514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.395771] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.396393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.396905] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58285e2b-e6f1-48cb-889c-ad2385869dbb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.437147] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.437381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.437381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.437541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.437666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.437965] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.438058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.438467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.438467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.438467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.438686] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea already deleted. [ 1075.438686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.608160] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.608804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.608804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.608804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.609034] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.609130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.609195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.609354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.609438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.609612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.609791] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.609915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.609973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.610142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.610294] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.610545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.610648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.610809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.610889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.610975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.611085] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.725620] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.725867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.725867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.726130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.726226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.726339] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be created. [ 1075.754921] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.755162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.755162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.755397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.755568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.768502] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: UNINITIALIZED for 2s [ 1075.899799] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.900081] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.900081] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.900366] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.900519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.900687] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 58285e2b-e6f1-48cb-889c-ad2385869dbb not found, creating... [ 1075.901035] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.901199] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.901320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.901547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.901689] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.901976] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.902148] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.902274] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.902474] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.902609] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.902749] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb is going to be created. [ 1075.925939] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.926297] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.926627] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.927062] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.927520] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.927891] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.114394] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71307925-e0d7-49c9-8bc8-5c5e870d7bca: rpc.has_security_group_logging(os_id): False [ 1076.139503] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.139749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.139749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.139930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.140033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.140233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.140402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.140402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.140543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.140633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.140818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.140914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.140975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.141155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.141266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.141483] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.141581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.141710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.141778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.141854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.141940] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1076.219269] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.219488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.219605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.219889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.220126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.235341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1076.621468] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: SUCCESS [ 1076.621807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.621905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.622136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.622339] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.622459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.622530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.622685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.622768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.622855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.622951] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.644873] env[65446]: INFO networking_nsxv3.common.synchronization [req-8d90d8b1-1948-4a62-9703-e3fab4f81adb req-8d0d0db1-ed79-4c4a-a955-ec2edc855ab5 service nova] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_rules [ 1076.645048] env[65446]: INFO networking_nsxv3.common.synchronization [req-8d90d8b1-1948-4a62-9703-e3fab4f81adb req-8d0d0db1-ed79-4c4a-a955-ec2edc855ab5 service nova] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1076.645156] env[65446]: INFO networking_nsxv3.common.synchronization [req-8d90d8b1-1948-4a62-9703-e3fab4f81adb req-8d0d0db1-ed79-4c4a-a955-ec2edc855ab5 service nova] Enqueued Resource ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb with Priority: HIGHEST for action port [ 1076.646114] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_rules [ 1076.646268] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1076.646373] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb with Priority: HIGHEST for action port [ 1076.646697] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.646837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.646877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.647746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.647746] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.648668] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.648783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.648850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.649049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.649709] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.649709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.649709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.649927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.649964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.650104] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.651535] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-58285e2b-e6f1-48cb-889c-ad2385869dbb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.651535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.651535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.651535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.651535] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58285e2b-e6f1-48cb-889c-ad2385869dbb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.074875] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1077.075237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.075483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.075803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.075945] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.125740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.126035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.126035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.126348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.126464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.126629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.126775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.126969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.127112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.127229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.127413] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.127561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.127718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.127928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.128237] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.128418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.128560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.128860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.128993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.129159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.129285] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.153080] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.153328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.153528] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.154654] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58285e2b-e6f1-48cb-889c-ad2385869dbb with status ACTIVE [ 1077.154856] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.155038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.155159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.155362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.155450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.155676] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.155819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.155904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.156117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.156227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.156479] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.156637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.156741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.156865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.156941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.157072] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb is going to be updated. [ 1077.185290] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.185571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.185571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.185815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.186019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.186202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.578801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.579061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.579262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.579538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.579766] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.579911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.580014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.580225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.580343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.580473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.580591] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.631980] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b114036a-38e3-4f81-b1f6-91a83ad71c82: rpc.has_security_group_logging(os_id): False [ 1077.650507] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.650757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.650757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.651019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.651126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.651349] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.651450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.651512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.651698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.651788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.651978] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.652085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.652146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.652313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.652419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.652544] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.652632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.652689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.652826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.652900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.652988] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be created. [ 1077.658963] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.710697] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.710886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.711014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.711252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.711437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.721547] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: IN_PROGRESS for 2s [ 1077.778687] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1077.778990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.779196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.779411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.779609] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.779741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.779808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.779962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.780055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.780157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.780258] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.082973] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.083231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.083231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.083415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.083621] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.083730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.083791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.083953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.084054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.084144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.084293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.084388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.084451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.084607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.084745] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.084837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.084917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.085092] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.085171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.085253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.085343] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.161500] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.161731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.161731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.161993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.162169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.162314] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be created. [ 1078.189156] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.189427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.189427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.189639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.189847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.199890] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: UNINITIALIZED for 2s [ 1078.266510] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1078.266739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.282483] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.282764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.282764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.283084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.283313] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.283448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.283540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.283740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.283864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.283986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.284207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.284336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.284425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.284617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.284820] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.284953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.285055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.285243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.285350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.285469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.285599] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.588346] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 1078.609120] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.609378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.609464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.610162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.610288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.610523] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.610632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.610710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.610946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.611038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.611264] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.611407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.611534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.611607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.611670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.611836] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.611954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.612014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.612129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.612203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.612287] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1078.681671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.682099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.682099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.682213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.682401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.699900] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1078.788110] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e9ab12-2cc1-4bd6-971a-349ffed008be: rpc.has_security_group_logging(os_id): False [ 1078.807688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.807925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.807925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.808333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.808431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.808673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.808780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.808844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.809047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.809138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.809357] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.809468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.809545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.809670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.809762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.809977] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.810095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.810151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.810293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.810364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.810448] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be created. [ 1078.895197] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.895304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.895375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.895640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.895900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.910678] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1079.734883] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: SUCCESS [ 1079.735353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.211200] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1080.211529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.211989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.212216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.212461] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.212700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.212846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.213133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.213293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.213480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.213673] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.715944] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1080.716222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.716632] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.716766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.716815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.717027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.717190] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.717288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.717354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.717500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.717580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.717664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.717811] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.717947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.718050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.718220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.718359] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.718452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.718538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.718695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.718771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.718854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.718945] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.926685] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1080.927162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.220972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f4ebf69-d596-4a52-9bd0-640145a36fea: rpc.has_security_group_logging(os_id): False [ 1081.259882] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.260054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.260130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.260510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.260618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.260851] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.261012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.261012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.261368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.261457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.261665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.261781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.261843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.262065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.262236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.262852] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.262852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.262852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.263078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.263126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.263211] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be created. [ 1081.351352] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.351352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.351606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.351703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.351845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.366142] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: IN_PROGRESS for 2s [ 1081.647998] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1081.649418] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1082.690580] env[65446]: INFO networking_nsxv3.common.synchronization [req-89b37240-3493-4c5c-a134-02e4f5b733d5 req-62afb14e-6a62-4e6c-badb-f69281f9c64a tempest-DeleteServersTestJSON-32184814 tempest-DeleteServersTestJSON-32184814-project-member] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 1082.691173] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGHEST for action security_group_members [ 1082.691476] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.691592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.691653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.691846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.692223] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.692223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.692380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.692431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.692480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.692569] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.198083] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.198083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.198083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.198083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.219635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.219936] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.220121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.220229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.220483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.220599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.220729] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be updated. [ 1083.254023] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.254175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.254275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.254512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.254685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.263887] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: IN_PROGRESS for 2s [ 1083.382030] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1083.382030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.332640] env[65446]: INFO networking_nsxv3.common.synchronization [req-945fc0a5-a0f3-4bd0-bcf1-caf1a5105f3d req-f31fc8ba-6bf8-4c7f-8c3b-1f32228ca31c tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1084.335806] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1084.335806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.335806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.335806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.335806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.335806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.335806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.335806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.335806] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.840291] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.275378] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 in Status: SUCCESS [ 1085.275657] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 deletion is rescheduled due to dependency. [ 1085.275755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.342850] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.845857] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.846063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.846111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.846341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.846429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.846630] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1085.873955] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.874138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.874186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.874386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.874525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.883650] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1087.897397] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1087.897723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.628243] env[65446]: INFO networking_nsxv3.common.synchronization [req-bbcda7d7-3cd9-4af8-b378-683db846267e req-004662ec-4bd3-4030-98ae-dd47e8dba7db tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1088.628899] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1088.629262] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.629388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.629453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.629642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.629812] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.629918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.629976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.631125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.631125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.631125] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.132973] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.133407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.133407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.133504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.133581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.133793] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.133896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.133961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.134131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.134207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.134486] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1089.165927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.166227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.166347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.166991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.167261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.179351] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1091.195875] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1091.196300] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be deletion is rescheduled due to dependency. [ 1091.196300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.772322] env[65446]: INFO networking_nsxv3.common.synchronization [req-89dafa7c-04de-44e9-b7e3-ef7ee70aa613 req-e8187b96-8284-4e70-8642-66e46e9279da tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_members [ 1092.773338] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGHEST for action security_group_members [ 1092.773882] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.774107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.774230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.774553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.774805] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.775022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.775146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.775419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.775620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.775761] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.282032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.282164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.282213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.282443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.282537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.282733] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.282833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.282892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.283057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.283191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.283239] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 is going to be updated. [ 1093.315569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.315795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.315795] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.316081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.316325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.327100] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: IN_PROGRESS for 2s [ 1094.149290] env[65446]: INFO networking_nsxv3.common.synchronization [req-bdf1c637-ea80-4bce-864d-b754c2d03abd req-eab0f868-aa0c-4401-a5e1-16489e718c9d tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_members [ 1094.150396] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGHEST for action security_group_members [ 1094.152661] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.152897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.153060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.153411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.153700] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.153891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.154036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.155326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.155326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.155326] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.364824] env[65446]: INFO networking_nsxv3.common.synchronization [req-e37c8ae7-ae33-453b-9608-f51bb1b539fe req-89eae04b-3cec-4b15-9116-1c70ac63bec8 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_members [ 1094.365120] env[65446]: INFO networking_nsxv3.common.synchronization [req-e37c8ae7-ae33-453b-9608-f51bb1b539fe req-89eae04b-3cec-4b15-9116-1c70ac63bec8 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1094.365577] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_members [ 1094.365716] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1094.366031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.366160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.366229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.366490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.366649] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.366747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.366814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.366996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.367173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.367271] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.368622] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.368786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.368849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.369061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.369199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.369297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.369360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.369501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.369583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.369676] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.418520] env[65446]: INFO networking_nsxv3.common.synchronization [req-e37c8ae7-ae33-453b-9608-f51bb1b539fe req-89eae04b-3cec-4b15-9116-1c70ac63bec8 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_rules [ 1094.418701] env[65446]: INFO networking_nsxv3.common.synchronization [req-e37c8ae7-ae33-453b-9608-f51bb1b539fe req-89eae04b-3cec-4b15-9116-1c70ac63bec8 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_members [ 1094.418930] env[65446]: INFO networking_nsxv3.common.synchronization [req-e37c8ae7-ae33-453b-9608-f51bb1b539fe req-89eae04b-3cec-4b15-9116-1c70ac63bec8 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_rules [ 1094.419155] env[65446]: INFO networking_nsxv3.common.synchronization [req-e37c8ae7-ae33-453b-9608-f51bb1b539fe req-89eae04b-3cec-4b15-9116-1c70ac63bec8 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1094.419353] env[65446]: INFO networking_nsxv3.common.synchronization [req-e37c8ae7-ae33-453b-9608-f51bb1b539fe req-89eae04b-3cec-4b15-9116-1c70ac63bec8 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb with Priority: HIGHEST for action port [ 1094.420088] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_rules [ 1094.420272] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_rules [ 1094.420402] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb with Priority: HIGHEST for action port [ 1094.420527] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_members [ 1094.420660] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1094.421690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.421894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.421951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.422269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.422358] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.423337] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.423461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.423545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.423754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.423930] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.427690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-58285e2b-e6f1-48cb-889c-ad2385869dbb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.427690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.427690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.427690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.427690] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58285e2b-e6f1-48cb-889c-ad2385869dbb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.427690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.427690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.427690] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.427690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.657991] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.658214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.658326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.658615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.658747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.659016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.659685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.659685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.659685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.659685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.659685] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6972103-6289-4c91-918e-1586283726a6 is going to be updated. [ 1094.693419] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.693691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.693854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.694282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.694516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.706776] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: IN_PROGRESS for 2s [ 1094.869828] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.871851] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.929026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.929026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.929026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.929026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.929026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58285e2b-e6f1-48cb-889c-ad2385869dbb with status ACTIVE [ 1094.929026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.929026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.929026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.929026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.929026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.929026] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.929638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.929638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.929638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.929638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.929638] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.929638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.929880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.929880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.929880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.929988] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb is going to be updated. [ 1094.956192] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.956415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.956415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.956495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.956761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.956977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.060409] env[65446]: INFO networking_nsxv3.common.synchronization [req-a263d945-2330-443a-a42c-052fa3183f4c req-4aa7906c-7a2c-41c5-8404-f9757db5674d tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_members [ 1095.060409] env[65446]: INFO networking_nsxv3.common.synchronization [req-a263d945-2330-443a-a42c-052fa3183f4c req-4aa7906c-7a2c-41c5-8404-f9757db5674d tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1095.062657] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 with Priority: HIGHEST for action security_group_members [ 1095.063611] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1095.063611] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.063611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.063611] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.063611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.132587] env[65446]: INFO networking_nsxv3.common.synchronization [req-a263d945-2330-443a-a42c-052fa3183f4c req-4aa7906c-7a2c-41c5-8404-f9757db5674d tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_rules [ 1095.132587] env[65446]: INFO networking_nsxv3.common.synchronization [req-a263d945-2330-443a-a42c-052fa3183f4c req-4aa7906c-7a2c-41c5-8404-f9757db5674d tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1095.132587] env[65446]: INFO networking_nsxv3.common.synchronization [req-a263d945-2330-443a-a42c-052fa3183f4c req-4aa7906c-7a2c-41c5-8404-f9757db5674d tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb with Priority: HIGHEST for action port [ 1095.133934] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_rules [ 1095.134097] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1095.134240] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb with Priority: HIGHEST for action port [ 1095.134486] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.134590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.134788] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.134872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.135234] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-58285e2b-e6f1-48cb-889c-ad2385869dbb taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.135234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.135234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.135428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.135508] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58285e2b-e6f1-48cb-889c-ad2385869dbb',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.336959] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 in Status: SUCCESS [ 1095.369897] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 deletion is rescheduled due to dependency. [ 1095.369897] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.372497] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.376561] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.637790] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58285e2b-e6f1-48cb-889c-ad2385869dbb with status ACTIVE [ 1095.638089] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.638295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.638411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.638648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.638759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.638989] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.639108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.639171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.639345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.639424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.639806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.639943] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.640054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.641622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.641622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.641622] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58285e2b-e6f1-48cb-889c-ad2385869dbb is going to be updated. [ 1095.661785] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.661998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.661998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.662228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.662382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.662622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58285e2b-e6f1-48cb-889c-ad2385869dbb" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.877721] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.877810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.877854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.878106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.878577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.878577] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 is going to be created. [ 1095.879750] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.879973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.879973] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.880285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.880285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.880388] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be updated. [ 1095.908105] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.908361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.908361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.908521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.908680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.912464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.912594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.912664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.912846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.912981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.923302] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: IN_PROGRESS for 2s [ 1095.924020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 in Status: UNINITIALIZED for 2s [ 1096.717483] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6972103-6289-4c91-918e-1586283726a6 in Status: SUCCESS [ 1096.717483] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6972103-6289-4c91-918e-1586283726a6 deletion is rescheduled due to dependency. [ 1096.717483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.938030] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1097.938362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.938561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.938847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.939252] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.939349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.939349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.940519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.940519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.940884] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.944640] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 in Status: SUCCESS [ 1097.944640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.944640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.944640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.944640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.944640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.944640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.976458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.976458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.976458] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.449281] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.449493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.449595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.450074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.450074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.450318] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.450468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.450550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.450710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.451281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.451281] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 is going to be deleted. [ 1098.452664] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.484967] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.484967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.484967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.485278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.485278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.485413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.485593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.485699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.485893] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.485972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.486106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.486269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.486348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.486463] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.956611] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.989560] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.989708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.989771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.992263] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.992263] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 already deleted. [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.992263] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.992263] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.992263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.992747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.992747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.992747] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.038853] env[65446]: INFO networking_nsxv3.common.synchronization [None req-923b9d11-6c28-4cbe-8522-625e36931834 tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_rules [ 1099.039406] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_rules [ 1099.039717] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.039857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.039933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.042923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.043037] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.148013] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4e621a8f-d1e8-480c-98aa-0bdc93ca81af tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_rules [ 1099.148576] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_rules [ 1099.148907] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.149190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.458404] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.458602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.458658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.458900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.459024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.459125] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be updated. [ 1099.495469] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.498666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.498666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.498666] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 already deleted. [ 1099.498666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.507035] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.507035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.507035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.507035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.507035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.518537] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: IN_PROGRESS for 2s [ 1099.573263] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.573263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.573263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.573263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.573263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.573263] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc already deleted. [ 1099.573263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.573263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.573263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.573263] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.003074] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1: rpc.has_security_group_logging(os_id): False [ 1100.026172] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.026172] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.026172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.026172] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 is going to be created. [ 1100.047167] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1], does not exist path=[/infra/domains/default/groups/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1]."\n}' [ 1100.047167] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 [ 1100.047167] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1100.085502] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.085604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.085680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.085918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.086987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.087350] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.087482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.087594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.087849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.087962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.088231] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.088375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.088459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.088639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.088750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.088880] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 is going to be created. [ 1100.099293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.099293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.099527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.099751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.099835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.099996] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc already deleted. [ 1100.100166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.110877] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1], does not exist path=[/infra/domains/default/groups/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 [ 1100.110877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.110877] env[65446]: Traceback (most recent call last): [ 1100.110877] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1100.110877] env[65446]: return func(*args, **kwargs) [ 1100.110877] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1100.110877] env[65446]: res.raise_for_status() [ 1100.110877] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1100.110877] env[65446]: raise HTTPError(http_error_msg, response=self) [ 1100.110877] env[65446]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 [ 1100.110877] env[65446]: During handling of the above exception, another exception occurred: [ 1100.110877] env[65446]: Traceback (most recent call last): [ 1100.110877] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1100.110877] env[65446]: listener.cb(fileno) [ 1100.110877] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1100.110877] env[65446]: result = function(*args, **kwargs) [ 1100.110877] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1100.110877] env[65446]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1100.110877] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1100.110877] env[65446]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1100.110877] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1100.110877] env[65446]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1100.110877] env[65446]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1100.110877] env[65446]: res.raise_for_status() [ 1100.110877] env[65446]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1100.110877] env[65446]: raise HTTPError(http_error_msg, response=self) [ 1100.110877] env[65446]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4c2b750e-cae9-4ff4-a3d6-a0d7cbfa11c1 [ 1100.110877] env[65446]: Removing descriptor: 68 [ 1100.813232] env[65446]: INFO networking_nsxv3.common.synchronization [req-c1afc064-7f78-47ae-bc28-120ef3809edc req-d85ac892-b068-4e8d-8b77-290c9deedf50 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1100.813791] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1100.814135] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.814236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.814304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.814501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.814650] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.814738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.814798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.814937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.815030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.815183] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.237076] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.237420] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.237420] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.237744] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.238098] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.238098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.238228] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.238367] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.238510] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.238798] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.238953] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.239090] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.239203] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.239318] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.239470] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.239552] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.256994] env[65446]: INFO networking_nsxv3.common.synchronization [req-ee3cac11-e10e-401d-b881-8e36cd9d0223 req-61e6a4ac-9050-419b-8a9a-7da9e6919571 tempest-ServersNegativeTestJSON-1295958692 tempest-ServersNegativeTestJSON-1295958692-project-member] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 1101.257865] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGHEST for action security_group_members [ 1101.258094] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.258304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.258378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.259079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.259079] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.259079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.259079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.259267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.259267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.259427] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.260982] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.261162] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.261370] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.263818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-208" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.263818] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-fef1bdcf-7e26-404b-bda4-46555167309d taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.263818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.263818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.263818] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.263818] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef1bdcf-7e26-404b-bda4-46555167309d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.318269] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.528895] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1101.529170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.529365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.529608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.529848] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.529977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.530080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.530280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.530366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.530552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.530676] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.531910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.532246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.532549] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.532720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.532824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.533107] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.533160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.533302] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.766490] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.766649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.766720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.767079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.768500] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.768610] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.768742] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.769054] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.769208] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.769355] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port fef1bdcf-7e26-404b-bda4-46555167309d not found, creating... [ 1101.769606] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.769747] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.769985] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.774371] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.774533] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.774906] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.775031] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.775337] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.775337] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.775489] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.775615] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: fef1bdcf-7e26-404b-bda4-46555167309d is going to be created. [ 1101.799465] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.799465] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.799465] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.799465] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.799649] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.800580] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.806464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.806464] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.806464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.806464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.806464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.806718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.806718] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be updated. [ 1101.821857] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.849751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.849934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.849976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.851053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.851053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.861076] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: IN_PROGRESS for 2s [ 1102.036474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.036652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.036872] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.324030] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.324400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.324400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.324501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.325173] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.325173] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1102.360832] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.361271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.361553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.361792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.362063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.372807] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1102.541190] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.562790] env[65446]: INFO networking_nsxv3.common.synchronization [req-c1afc064-7f78-47ae-bc28-120ef3809edc req-42ffd396-84fd-4d93-9005-5d9563afa2f2 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 1102.562790] env[65446]: INFO networking_nsxv3.common.synchronization [req-c1afc064-7f78-47ae-bc28-120ef3809edc req-42ffd396-84fd-4d93-9005-5d9563afa2f2 service nova] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1102.562790] env[65446]: INFO networking_nsxv3.common.synchronization [req-c1afc064-7f78-47ae-bc28-120ef3809edc req-42ffd396-84fd-4d93-9005-5d9563afa2f2 service nova] Enqueued Resource ID: fef1bdcf-7e26-404b-bda4-46555167309d with Priority: HIGHEST for action port [ 1102.563300] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_rules [ 1102.563768] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1102.563904] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef1bdcf-7e26-404b-bda4-46555167309d with Priority: HIGHEST for action port [ 1102.564192] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.564328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.564375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.564625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.564710] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.566204] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.566334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.568134] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-fef1bdcf-7e26-404b-bda4-46555167309d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.568542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.568542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.568734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.568838] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef1bdcf-7e26-404b-bda4-46555167309d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.044205] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.044446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.044501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.044797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.044884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.044993] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be updated. [ 1103.071653] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.071853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.072155] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fef1bdcf-7e26-404b-bda4-46555167309d with status ACTIVE [ 1103.072840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.072840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.072840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.072840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.072840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.073212] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.073212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.073212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.073362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.073409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.073626] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.073724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.073779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.074036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.074119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.074210] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fef1bdcf-7e26-404b-bda4-46555167309d is going to be updated. [ 1103.076203] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.076345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.076440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.076542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.076675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.088041] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: IN_PROGRESS for 2s [ 1103.102165] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.102321] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.102431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.102585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.102721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.102886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fef1bdcf-7e26-404b-bda4-46555167309d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.872618] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a035b80c-7bce-4315-917c-4962056ba63f in Status: SUCCESS [ 1103.872618] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a035b80c-7bce-4315-917c-4962056ba63f deletion is rescheduled due to dependency. [ 1103.873024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.095879] env[65446]: INFO networking_nsxv3.common.synchronization [req-1de3d0d4-2e17-47e6-be06-79f0757362a9 req-e5fdb613-5bce-435b-bd2c-6365810bbe68 tempest-ServerRescueTestJSONUnderV235-502719473 tempest-ServerRescueTestJSONUnderV235-502719473-project-member] Enqueued Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1104.096811] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea with Priority: HIGHEST for action security_group_members [ 1104.097079] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.097338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.386778] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1104.387208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.387323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.387718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.387718] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.387871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.387908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.388085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.388170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.388271] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.892470] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.075241] env[65446]: INFO networking_nsxv3.common.synchronization [req-7e92cdd1-c3bd-436c-97b5-c44c04f90c38 req-541b01b3-1dae-477b-ba83-5e3a2fa5ef7f tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1105.076572] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1105.076693] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.076857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.076981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.077222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.077411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.077543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.077612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.077801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.077894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.078016] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.098755] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1105.098755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.098755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.098755] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.098952] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.099129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.099204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.099372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.099506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.099548] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.394382] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.579936] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.580177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.580270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.580569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.601219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.601529] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.601695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.601807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.602025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.602117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.602228] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be updated. [ 1105.603520] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.603698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.603769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.603943] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.624413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.625267] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.625426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.625542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.625783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.625873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.626040] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be updated. [ 1105.638932] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.639142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.639215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.639427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.639581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.648032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: IN_PROGRESS for 2s [ 1105.658325] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.658505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.658548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.658955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.658955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.667309] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: IN_PROGRESS for 2s [ 1105.897941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.897941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.897941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.898355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.898355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.898355] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1105.925101] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.925267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.925339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.925542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.925683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.938138] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1106.943313] env[65446]: INFO networking_nsxv3.common.synchronization [req-98611132-0657-4d71-adcb-82b56d7cb38a req-baecd449-dac2-4204-bac5-0a3d946ee643 tempest-ListServerFiltersTestJSON-498940496 tempest-ListServerFiltersTestJSON-498940496-project-member] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1106.943930] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1106.944301] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.944433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.944508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.944784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.944976] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.945154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.945208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.945411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.945518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.945636] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.331036] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.331036] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.331036] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.331036] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.331036] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.331454] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.331673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.332082] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.332324] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.332639] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.332846] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.333081] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.333286] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.333484] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.333674] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.333908] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.354225] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.354225] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.354225] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.354225] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.354225] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-d8e29484-f699-4df6-a986-e921d912edd2 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.354225] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.354225] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.354611] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.354611] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e29484-f699-4df6-a986-e921d912edd2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.447985] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.448187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.448285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.448491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.448611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.448818] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.448914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.449028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.449243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.449317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.449415] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 already deleted. [ 1107.449501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.658838] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: SUCCESS [ 1107.658996] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 deletion is rescheduled due to dependency. [ 1107.659242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.676504] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1107.676692] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea deletion is rescheduled due to dependency. [ 1107.676813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.677203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.677426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.677626] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.677739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.677838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.677950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.678050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.678130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.678289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4ebf69-d596-4a52-9bd0-640145a36fea taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.678370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.678429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.678617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.678708] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.678801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.678874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.679151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.679236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.679318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.679409] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.680272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.680434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.680580] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.680694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.680758] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.680907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.680994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.681093] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.856682] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.856939] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.857124] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.857381] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.857538] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.857699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port d8e29484-f699-4df6-a986-e921d912edd2 not found, creating... [ 1107.857980] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.858177] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.858307] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.858524] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.858660] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.858991] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.859176] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.859262] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.859454] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.859587] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.859724] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: d8e29484-f699-4df6-a986-e921d912edd2 is going to be created. [ 1107.886923] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.887212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.887320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.887592] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.887827] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.888081] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.956610] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1107.956992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.956992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.957158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.957376] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.957498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.957559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.957720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.957803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.957914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.958065] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.182651] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f4ebf69-d596-4a52-9bd0-640145a36fea: rpc.has_security_group_logging(os_id): False [ 1108.184446] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.184631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.184797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.185039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.185186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.185498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.185640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.185789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.185954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.186226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.186376] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be updated. [ 1108.204692] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.204842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.204945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.205150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.205243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.205443] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.205642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.205722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.205876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.205954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.206164] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.206263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.206338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.206486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.206560] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.206757] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.206857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.206928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.207672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.207872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.207972] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be updated. [ 1108.222381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.222571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.222646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.222862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.223013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.235978] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: IN_PROGRESS for 2s [ 1108.285962] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.286125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.286198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.286424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.286561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.298590] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: IN_PROGRESS for 2s [ 1108.461020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.461219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.461258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.461498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.461695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.461804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.461869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.462054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.462148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.462245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.462401] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.462570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.462570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.462694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.462883] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.462982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.463071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.463214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.463292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.463376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.463470] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.622035] env[65446]: INFO networking_nsxv3.common.synchronization [req-98611132-0657-4d71-adcb-82b56d7cb38a req-250a3b27-c58b-4203-bb53-d950ef28fa30 service nova] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_rules [ 1108.622466] env[65446]: INFO networking_nsxv3.common.synchronization [req-98611132-0657-4d71-adcb-82b56d7cb38a req-250a3b27-c58b-4203-bb53-d950ef28fa30 service nova] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1108.622695] env[65446]: INFO networking_nsxv3.common.synchronization [req-98611132-0657-4d71-adcb-82b56d7cb38a req-250a3b27-c58b-4203-bb53-d950ef28fa30 service nova] Enqueued Resource ID: d8e29484-f699-4df6-a986-e921d912edd2 with Priority: HIGHEST for action port [ 1108.623250] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_rules [ 1108.623384] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1108.623479] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e29484-f699-4df6-a986-e921d912edd2 with Priority: HIGHEST for action port [ 1108.623765] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.623892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.623945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.624215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.624294] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.625253] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.625253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.625470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.625572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.625725] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.625821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.625880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.626047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.626137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.626249] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.627019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8e29484-f699-4df6-a986-e921d912edd2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.627131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.627185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.627385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.627385] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e29484-f699-4df6-a986-e921d912edd2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.966071] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b8bdb1-50db-4ff1-a172-37099eae0157: rpc.has_security_group_logging(os_id): False [ 1108.983024] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.983197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.983277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.983489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.001913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.002184] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.002306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.002375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.002568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.002650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.002857] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.002954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.003029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.003178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.003253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.003427] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.003521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.003582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.003717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.003790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.003872] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1109.068532] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.068694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.068759] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.069054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.069260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.085953] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1109.129669] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.129669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.133131] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8e29484-f699-4df6-a986-e921d912edd2 with status ACTIVE [ 1109.133859] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.133859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.133859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.133859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.133859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.133859] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.134096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.134096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.134159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.134229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.134508] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.134598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.134662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.134802] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.134870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.134952] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8e29484-f699-4df6-a986-e921d912edd2 is going to be updated. [ 1109.136339] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.185018] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.185230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.185331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.185925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.185925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.185925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8e29484-f699-4df6-a986-e921d912edd2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.396548] env[65446]: INFO networking_nsxv3.common.synchronization [req-b8d96084-d474-4ee2-91dc-9ec1c32ea3ff req-51c38ebd-678e-4a20-a68b-91e9783b0a9a tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_members [ 1109.397918] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_members [ 1109.397918] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.397918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.397918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.398553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.398553] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.398553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.398553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.398668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.398751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.398814] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.639406] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.726104] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.726359] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.726490] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.726760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.727115] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.727294] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.727388] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.727599] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.727739] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.727939] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.728059] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.728170] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.728277] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.728386] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.728490] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.728617] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.748215] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.748352] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.748487] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.748665] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.749031] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-05f4c0e1-cbcc-43f8-bef2-272bf4454475 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.749319] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.749680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.750048] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.750222] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f4c0e1-cbcc-43f8-bef2-272bf4454475',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.901066] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.901275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.901373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.901657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.901818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.902099] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.902253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.902315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.902520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.902635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.902740] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc already deleted. [ 1109.902871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.141596] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.141975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.141975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.142059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.142148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.142264] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be created. [ 1110.167410] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.167620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.167620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.167784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.167946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.177021] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: UNINITIALIZED for 2s [ 1110.245151] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1110.245380] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea deletion is rescheduled due to dependency. [ 1110.245512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.252936] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.253255] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.253416] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.253710] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.253860] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.254028] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 05f4c0e1-cbcc-43f8-bef2-272bf4454475 not found, creating... [ 1110.254473] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.254672] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.254798] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.255104] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.255298] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.255653] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.255825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.255948] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.256334] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.256535] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.256699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 05f4c0e1-cbcc-43f8-bef2-272bf4454475 is going to be created. [ 1110.277142] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.277377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.277506] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.277780] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.278040] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.278264] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.319636] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea in Status: SUCCESS [ 1110.319856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.320149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.320444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.320565] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f4ebf69-d596-4a52-9bd0-640145a36fea',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.680567] env[65446]: INFO networking_nsxv3.common.synchronization [req-823eb2bf-5372-45cf-9105-907e198782ea req-fc9368bc-3fb0-4996-938e-5cb81e852541 tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 1110.681173] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 1110.681504] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.681629] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.681704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.681915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.682187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.682187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.682620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.682620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.682620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.682620] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.846760] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.847035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.847103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.847331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.847423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.847524] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f4ebf69-d596-4a52-9bd0-640145a36fea is going to be deleted. [ 1110.905666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.905886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.905999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.906338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.906491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.906667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f4ebf69-d596-4a52-9bd0-640145a36fea" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.999383] env[65446]: INFO networking_nsxv3.common.synchronization [req-b8d96084-d474-4ee2-91dc-9ec1c32ea3ff req-a304923a-92af-4e89-bf78-ee11b6db0f3c service nova] Enqueued Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_rules [ 1110.999611] env[65446]: INFO networking_nsxv3.common.synchronization [req-b8d96084-d474-4ee2-91dc-9ec1c32ea3ff req-a304923a-92af-4e89-bf78-ee11b6db0f3c service nova] Enqueued Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_members [ 1110.999766] env[65446]: INFO networking_nsxv3.common.synchronization [req-b8d96084-d474-4ee2-91dc-9ec1c32ea3ff req-a304923a-92af-4e89-bf78-ee11b6db0f3c service nova] Enqueued Resource ID: 05f4c0e1-cbcc-43f8-bef2-272bf4454475 with Priority: HIGHEST for action port [ 1111.000452] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_rules [ 1111.000621] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_members [ 1111.000688] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f4c0e1-cbcc-43f8-bef2-272bf4454475 with Priority: HIGHEST for action port [ 1111.000993] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.001694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.001773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.001998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.002104] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.003101] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.003271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.003323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.003886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.004516] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.004707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.004707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.005266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.005266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.005266] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.005994] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-05f4c0e1-cbcc-43f8-bef2-272bf4454475 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.006119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.006213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.006350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.006428] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f4c0e1-cbcc-43f8-bef2-272bf4454475',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.109056] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1111.109267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.184492] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.509787] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.510042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.510205] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.513684] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05f4c0e1-cbcc-43f8-bef2-272bf4454475 with status ACTIVE [ 1111.513684] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.513684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.513684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.513684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.513684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.513992] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.514072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.514072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.518301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.518301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.518301] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.518301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.518301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.518301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.518301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.518301] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05f4c0e1-cbcc-43f8-bef2-272bf4454475 is going to be updated. [ 1111.559516] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.559516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.559516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.559516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.559516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.559516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05f4c0e1-cbcc-43f8-bef2-272bf4454475" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.688418] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.018863] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.190057] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1112.190343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.190482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.190697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.190899] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.191048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.191108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.191248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.191327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.191412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.191501] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.192947] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.193084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.193135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.193282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.193360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.193445] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be updated. [ 1112.223135] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.223135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.223293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.223393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.223534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.232969] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 1112.524166] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.524166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.524166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.524166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.524166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.524166] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc is going to be created. [ 1112.547103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.547241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.547281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.547911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.547911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.560110] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc in Status: UNINITIALIZED for 2s [ 1112.694200] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.694366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.694441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.694669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.694842] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.694960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.695015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.695192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.695254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.695347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.695496] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.695593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.695650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.695829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.695981] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.696151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.696227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.696405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.696499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.696587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.696683] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.204913] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235: rpc.has_security_group_logging(os_id): False [ 1113.229170] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.229170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.229170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.229170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.229170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.229170] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.229170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.229170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.229741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.229741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.229741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.229741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.229741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.230081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.230253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.230503] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.230670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.230744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.230906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.231020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.231110] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be created. [ 1113.316302] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.316508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.316508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.316821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.317081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.334576] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1113.757160] env[65446]: INFO networking_nsxv3.common.synchronization [req-638e33de-a5fb-4143-a83c-bcc1a8fe9167 req-6225c480-0113-4856-a29d-65d9e1b46f1a tempest-ListServerFiltersTestJSON-498940496 tempest-ListServerFiltersTestJSON-498940496-project-member] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1113.757817] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1113.758575] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.758575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.758575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.758575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.758575] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.759727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.759727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.759727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.759727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.761380] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.119267] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.119399] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.119520] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.119851] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.120225] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.120397] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.120517] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.120735] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.120931] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.121170] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.121289] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.121419] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.121539] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.121652] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.121856] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.122091] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.140982] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.141247] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1114.141379] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.141575] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.141944] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-92752c5b-8885-4020-8605-c968aef751e9 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.142145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.142271] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.142584] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.142774] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92752c5b-8885-4020-8605-c968aef751e9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.245177] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 4s [ 1114.265276] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.570534] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc in Status: SUCCESS [ 1114.570790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.571081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.571194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.571401] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.571518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.571583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.571736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.571818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.571909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.572036] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.644890] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.645130] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.645263] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.645554] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.645706] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.645863] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 92752c5b-8885-4020-8605-c968aef751e9 not found, creating... [ 1114.646145] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.646304] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.646422] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.646639] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.646776] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.647184] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.647377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.647499] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.647708] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.647846] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.647990] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 92752c5b-8885-4020-8605-c968aef751e9 is going to be created. [ 1114.673664] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.673664] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.673664] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.673928] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.674073] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.674298] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.768062] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.074722] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.273538] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.273538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.273538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.273538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.273538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.273538] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1115.305913] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.306121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.306205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.306469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.307135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.318437] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1115.350162] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1115.350315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.453039] env[65446]: INFO networking_nsxv3.common.synchronization [req-638e33de-a5fb-4143-a83c-bcc1a8fe9167 req-d58411c6-cbc2-418f-bb7e-f5ed841c489c service nova] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_rules [ 1115.453039] env[65446]: INFO networking_nsxv3.common.synchronization [req-638e33de-a5fb-4143-a83c-bcc1a8fe9167 req-d58411c6-cbc2-418f-bb7e-f5ed841c489c service nova] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1115.453039] env[65446]: INFO networking_nsxv3.common.synchronization [req-638e33de-a5fb-4143-a83c-bcc1a8fe9167 req-d58411c6-cbc2-418f-bb7e-f5ed841c489c service nova] Enqueued Resource ID: 92752c5b-8885-4020-8605-c968aef751e9 with Priority: HIGHEST for action port [ 1115.453610] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_rules [ 1115.453691] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1115.453850] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92752c5b-8885-4020-8605-c968aef751e9 with Priority: HIGHEST for action port [ 1115.454259] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.454259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.454259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.454539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.454539] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.455435] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.455562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.455718] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-92752c5b-8885-4020-8605-c968aef751e9 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.455842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.455913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.456099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.456164] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92752c5b-8885-4020-8605-c968aef751e9',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.577787] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc: rpc.has_security_group_logging(os_id): False [ 1115.598358] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.598509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.598578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.598790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.598881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.599208] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.599343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.599428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.599615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.599695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.599788] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc is going to be created. [ 1115.661508] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.661682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.661757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.661966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.662175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.676119] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc in Status: IN_PROGRESS for 2s [ 1115.958317] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.958621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.958852] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92752c5b-8885-4020-8605-c968aef751e9 with status ACTIVE [ 1115.959176] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.959351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.959429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.959656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.959750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.959937] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.960541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.960541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.960541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.960541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.960745] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.960996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.961100] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.961459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.961561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.961635] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92752c5b-8885-4020-8605-c968aef751e9 is going to be updated. [ 1115.984031] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.984182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.984182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.984394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.984548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.984716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92752c5b-8885-4020-8605-c968aef751e9" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.255657] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 1116.255877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.686022] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.686022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.686022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.686022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.686022] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.686022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.686022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.686814] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.687158] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.687541] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.690056] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.690056] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.690056] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.690056] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.690056] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.690056] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.713411] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.713623] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.713769] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.713944] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.714279] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-cda7f4f7-5287-468c-8433-4e25bead9dc8 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.714460] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.714581] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.714852] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.714987] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda7f4f7-5287-468c-8433-4e25bead9dc8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.218968] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.219278] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.219513] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.219825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.220038] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.220379] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.220560] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.220824] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.220985] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.221144] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.221489] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.221709] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.221908] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.222136] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.222295] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.222440] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 is going to be updated. [ 1117.245024] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.245316] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.245483] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.245850] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.246085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.246400] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.331788] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1117.332632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.332632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.332632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.332632] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.332975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.332975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.332975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.333094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.333194] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.688920] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc in Status: SUCCESS [ 1117.689282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.836037] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.975304] env[65446]: INFO networking_nsxv3.common.synchronization [req-89a36cde-ee64-4659-ad13-3d21cc1bfe1c req-4d591380-7703-43b9-9fe2-8ae6ffc50878 service nova] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 1117.975385] env[65446]: INFO networking_nsxv3.common.synchronization [req-89a36cde-ee64-4659-ad13-3d21cc1bfe1c req-4d591380-7703-43b9-9fe2-8ae6ffc50878 service nova] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 1117.975517] env[65446]: INFO networking_nsxv3.common.synchronization [req-89a36cde-ee64-4659-ad13-3d21cc1bfe1c req-4d591380-7703-43b9-9fe2-8ae6ffc50878 service nova] Enqueued Resource ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 with Priority: HIGHEST for action port [ 1117.976054] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_rules [ 1117.976198] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 1117.976299] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 with Priority: HIGHEST for action port [ 1117.976657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.976748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.976788] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.977234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.977234] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.978636] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.978773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.978842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.979040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.979230] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.979325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.979398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.979637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.979687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.979783] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.980927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-cda7f4f7-5287-468c-8433-4e25bead9dc8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.981158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.981451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.981519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.981621] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda7f4f7-5287-468c-8433-4e25bead9dc8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.338112] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.480187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.480386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.481779] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.484577] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cda7f4f7-5287-468c-8433-4e25bead9dc8 with status ACTIVE [ 1118.484577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.484577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.484783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.485114] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.485114] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.485114] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.485367] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.485367] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.485505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.485505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.485700] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.485779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.485835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.486186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.486186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.486186] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cda7f4f7-5287-468c-8433-4e25bead9dc8 is going to be updated. [ 1118.492974] env[65446]: INFO networking_nsxv3.common.synchronization [req-3f8880a6-8ed6-4255-8e97-07a2dc89277e req-fa276692-9ae3-450c-b323-cb05c96181b8 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1118.495548] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1118.495548] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.495548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.495548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.495548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.495548] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.495548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.495548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.495548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.495548] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.495548] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.509672] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.509875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.509875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.510108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.510270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.510444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cda7f4f7-5287-468c-8433-4e25bead9dc8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.841641] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.841641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.842061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.842061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.842172] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.842376] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1118.871231] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.871413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.871452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.871726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.871893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.882899] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1118.984584] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.999792] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.487799] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.487799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.487799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.487799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.488093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.488093] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e is going to be updated. [ 1119.503098] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.524153] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.524391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.524522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.527041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.527041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.541752] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: IN_PROGRESS for 2s [ 1119.617948] env[65446]: INFO networking_nsxv3.common.synchronization [req-b1bdeff1-5852-433f-87cd-998068792474 req-7e257205-3e3d-4ec6-b2b6-71b54a283ad8 tempest-ListServerFiltersTestJSON-498940496 tempest-ListServerFiltersTestJSON-498940496-project-member] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1119.619740] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1119.619740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.619740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.954027] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.954027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.954027] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.954569] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.954945] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.955200] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.955332] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.955608] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.955825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.956097] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.956242] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.956381] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.956521] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.956656] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.956767] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.956975] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.979305] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.979305] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.979305] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.979427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-388" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.979821] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.980408] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.980408] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.981075] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.981075] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5b1164d-78e3-4c56-b0fd-5ff3277aa42b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.004567] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.004567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.004567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.004567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.004567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.004853] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1120.036742] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.036964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.037115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.037374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.037528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.048531] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1120.483779] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.484041] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.484168] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.484470] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.484627] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.484790] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port e5b1164d-78e3-4c56-b0fd-5ff3277aa42b not found, creating... [ 1120.485411] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.485411] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.485411] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.485655] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.485700] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.485998] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.486174] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.486328] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.486509] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.486643] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.486788] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: e5b1164d-78e3-4c56-b0fd-5ff3277aa42b is going to be created. [ 1120.511630] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.511980] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.512123] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.513605] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.513605] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.513605] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.897725] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1120.899517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.899803] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.900097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.900569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.900569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.900756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.900756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.900838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.900932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.901185] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.902091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.902258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.902427] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.902532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.902587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.902830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.902830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.902995] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.238171] env[65446]: INFO networking_nsxv3.common.synchronization [req-b1bdeff1-5852-433f-87cd-998068792474 req-410384b5-7a83-4143-9e98-883c21d626f5 service nova] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_rules [ 1121.238171] env[65446]: INFO networking_nsxv3.common.synchronization [req-b1bdeff1-5852-433f-87cd-998068792474 req-410384b5-7a83-4143-9e98-883c21d626f5 service nova] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1121.238171] env[65446]: INFO networking_nsxv3.common.synchronization [req-b1bdeff1-5852-433f-87cd-998068792474 req-410384b5-7a83-4143-9e98-883c21d626f5 service nova] Enqueued Resource ID: e5b1164d-78e3-4c56-b0fd-5ff3277aa42b with Priority: HIGHEST for action port [ 1121.238171] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_rules [ 1121.238171] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1121.238171] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b1164d-78e3-4c56-b0fd-5ff3277aa42b with Priority: HIGHEST for action port [ 1121.238171] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.238171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.238911] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.239164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.239628] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.239859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.240011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.240307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.241424] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5b1164d-78e3-4c56-b0fd-5ff3277aa42b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.405284] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.408110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.408110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.550609] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: SUCCESS [ 1121.550864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.551076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.551315] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.551639] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.551785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.551864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.552097] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.552198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.552333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.552472] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.744957] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5b1164d-78e3-4c56-b0fd-5ff3277aa42b with status ACTIVE [ 1121.745334] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.745334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.745518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.745641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.745732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.745918] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.746021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.746088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.746233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.746311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.746531] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.746631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.746693] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.746833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.746906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.746991] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5b1164d-78e3-4c56-b0fd-5ff3277aa42b is going to be updated. [ 1121.770648] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.770880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.770880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.771089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.771227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.771398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5b1164d-78e3-4c56-b0fd-5ff3277aa42b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.913980] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.056209] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.058969] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1122.059256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.416251] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.416735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.416735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.416735] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.416915] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.416915] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1122.454397] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.454485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.454485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.454825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.454937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.469871] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1122.559561] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b57e5c1-c933-4317-815e-0311cc4e843e: rpc.has_security_group_logging(os_id): False [ 1122.577903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.578083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.578135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.578383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.600907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.601279] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.601403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.601516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.601734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.601823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.601917] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e is going to be updated. [ 1122.672029] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.672029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.672029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.672029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.672029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.688556] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: IN_PROGRESS for 2s [ 1124.480410] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1124.480721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.481956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.481956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.481956] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.481956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.481956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.481956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.481956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.481956] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.536971] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d8cba286-c8e2-4c8e-9920-efe831cb1926 tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_rules [ 1124.537651] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_rules [ 1124.537999] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.538241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.538241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.538527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.538756] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.662727] env[65446]: INFO networking_nsxv3.common.synchronization [None req-4735e1e7-5854-444a-abb0-ada07a256fda tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_rules [ 1124.664183] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_rules [ 1124.664471] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.664611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.706157] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: SUCCESS [ 1124.706403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.985268] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.059054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.059276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.059330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.059525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.059618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.059713] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe already deleted. [ 1125.059814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.060024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.060136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.060269] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.488281] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.583692] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.583819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.583893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.584126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.584218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.584318] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe already deleted. [ 1125.584403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.990957] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.991153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.991223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.991476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.991610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.991785] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1126.024468] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.024625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.024685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.024891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.025041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.035969] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1128.052815] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1128.053210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.053346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.053920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.053920] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.053920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.053920] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.054175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.054207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.054328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.054560] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.054696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.054766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.054928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.055214] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.055347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.055423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.055580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.055731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.055824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.055923] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.538387] env[65446]: INFO networking_nsxv3.common.synchronization [None req-3377fd86-bd0a-4ba1-861e-a2b3584b5597 tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 453a075c-df61-4045-afc9-ee1f529f3e39 with Priority: HIGHEST for action security_group_rules [ 1128.539038] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453a075c-df61-4045-afc9-ee1f529f3e39 with Priority: HIGHEST for action security_group_rules [ 1128.539420] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453a075c-df61-4045-afc9-ee1f529f3e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.539567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.539637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.539978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.540103] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453a075c-df61-4045-afc9-ee1f529f3e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.559784] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235: rpc.has_security_group_logging(os_id): False [ 1128.580612] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.580813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.580813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.580976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.581120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.581564] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.581564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.581564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.581754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.581797] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.582189] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.582189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.582189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.582357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.582433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.582666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.582764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.582842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.582936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.583029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.583121] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1128.638812] env[65446]: INFO networking_nsxv3.common.synchronization [None req-93e994fe-119e-4db3-afa3-8aa1b0c22e6b tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 453a075c-df61-4045-afc9-ee1f529f3e39 with Priority: HIGHEST for action security_group_rules [ 1128.639429] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453a075c-df61-4045-afc9-ee1f529f3e39 with Priority: HIGHEST for action security_group_rules [ 1128.640046] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453a075c-df61-4045-afc9-ee1f529f3e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.640046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.663838] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.664106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.664106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.664336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.664480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.682380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1129.063027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.063301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.063301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.063556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.063691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.063828] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453a075c-df61-4045-afc9-ee1f529f3e39 already deleted. [ 1129.063955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.064193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.064425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.064552] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453a075c-df61-4045-afc9-ee1f529f3e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.267511] env[65446]: INFO networking_nsxv3.common.synchronization [req-bbe66be5-e3dc-492f-a1d0-60f108441ed8 req-6dbce683-6e1e-438c-b5c2-125c88893915 tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1129.268062] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1129.268368] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.268490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.268624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.268772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.268943] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.269051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.269115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.269323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.269421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.269514] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.587344] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.587652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.587793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.588047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.588123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.588187] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453a075c-df61-4045-afc9-ee1f529f3e39 already deleted. [ 1129.588267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453a075c-df61-4045-afc9-ee1f529f3e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.772731] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.772928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.772967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.773226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.811774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.811774] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.812051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.812051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.812227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.812354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.812467] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1129.868280] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.868570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.868935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.868935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.869113] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.883094] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1130.701440] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1130.701840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.701907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.702157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.702251] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.204614] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.204775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.204844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.205086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.205275] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.205375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.205437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.205591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.205679] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.205877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.205877] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.708555] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.708906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.708906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.709298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.709636] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.709816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.709951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.710290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.710393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.710537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.710752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.710894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.710971] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.711233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.711423] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.711574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.711687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.711974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.712094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.712188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.712305] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.895951] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1131.895951] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 deletion is rescheduled due to dependency. [ 1131.895951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.215019] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235: rpc.has_security_group_logging(os_id): False [ 1132.235676] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.235895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.235895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.236119] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.236221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.236565] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.236684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.236750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.236916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.237023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.237232] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.237389] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.237463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.237617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.237742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.237907] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.238009] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.238110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.238224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.238300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.238412] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1132.360154] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.360154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.360284] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.360581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.360671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.379128] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1133.426998] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c332e21-47e0-4a8c-be75-06368e37ff20 req-db8433a2-6329-4167-b77c-65a099deb21d tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1133.427653] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1133.427975] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.428117] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.428185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.428406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.428533] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.428642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.428723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.429072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.429072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.429214] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.607276] env[65446]: INFO networking_nsxv3.common.synchronization [req-4ac3ac0a-044a-436f-8974-8d5794a508a7 req-bc867dd2-bd17-47e7-83b9-901d2159f6ee tempest-ServerRescueNegativeTestJSON-1890048273 tempest-ServerRescueNegativeTestJSON-1890048273-project-member] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 1133.607857] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGHEST for action security_group_members [ 1133.608226] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.608351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.608405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.608610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.608766] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.609013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.609013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.609118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.609170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.609267] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.931072] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.931282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.931379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.931723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.956345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.956400] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.956509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.956700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.956830] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.956948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.957060] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1133.992139] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.992342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.992442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.992903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.993074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.004165] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1134.111980] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.112268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.112268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.112505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.138155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.138155] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.138155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.138155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.138155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.138155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.138155] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be updated. [ 1134.170732] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.170732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.170732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.170732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.170732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.183123] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: IN_PROGRESS for 2s [ 1134.401569] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1134.401569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.631817] env[65446]: INFO networking_nsxv3.common.synchronization [req-2f0129a9-e33d-4436-9fa2-aa62eafa187c req-b9520abe-6251-46aa-b24c-3a13ef1985ea tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_members [ 1134.632542] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_members [ 1134.633075] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.633278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.633367] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.633768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.633989] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.634149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.634277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.634521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.634622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.634714] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.021121] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.021433] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.021587] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.021943] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.022305] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.022491] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.022616] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.022899] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.023066] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.023343] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.023474] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.023651] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.023762] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.023908] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.024072] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.024228] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.048121] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.048281] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.048389] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.048575] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.048915] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-13805cab-1b2c-4c4b-bed7-a3c1da106464 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.049119] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.049243] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.049706] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.049844] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13805cab-1b2c-4c4b-bed7-a3c1da106464',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.138016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.138391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.138391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.138587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.138747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.139028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.139139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.139204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.139471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.139613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.139756] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe already deleted. [ 1135.139874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.228118] env[65446]: INFO networking_nsxv3.common.synchronization [req-3e512032-1b1c-4f3f-8010-3422989b29ac req-b694fa10-ecf1-4824-b31e-7fce0607d931 tempest-ServersTestJSON-1363285984 tempest-ServersTestJSON-1363285984-project-member] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1135.229160] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGHEST for action security_group_members [ 1135.229672] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.229838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.229960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.230416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.230531] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.230668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.230764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.231069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.231171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.231307] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.552842] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.553170] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.553347] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.553707] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.553959] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.554188] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 13805cab-1b2c-4c4b-bed7-a3c1da106464 not found, creating... [ 1135.554520] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.554769] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.554867] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.555137] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.555289] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.555629] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.555756] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.557227] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.557227] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.557227] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.557227] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 13805cab-1b2c-4c4b-bed7-a3c1da106464 is going to be created. [ 1135.587255] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.587552] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.587684] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.587965] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.588203] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.588426] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.734966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.734966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.735343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.735343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.736667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.736667] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.736667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.736667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.736667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.736667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.736667] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be updated. [ 1135.793499] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.793499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.793499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.793882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.793882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.804184] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: IN_PROGRESS for 2s [ 1136.016949] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1136.016949] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1136.017187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.195694] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 in Status: SUCCESS [ 1136.195694] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 deletion is rescheduled due to dependency. [ 1136.195694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.361049] env[65446]: INFO networking_nsxv3.common.synchronization [req-2f0129a9-e33d-4436-9fa2-aa62eafa187c req-e6ba4235-05eb-4c30-81fb-9fe892db34ac service nova] Enqueued Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_rules [ 1136.361049] env[65446]: INFO networking_nsxv3.common.synchronization [req-2f0129a9-e33d-4436-9fa2-aa62eafa187c req-e6ba4235-05eb-4c30-81fb-9fe892db34ac service nova] Enqueued Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_members [ 1136.361049] env[65446]: INFO networking_nsxv3.common.synchronization [req-2f0129a9-e33d-4436-9fa2-aa62eafa187c req-e6ba4235-05eb-4c30-81fb-9fe892db34ac service nova] Enqueued Resource ID: 13805cab-1b2c-4c4b-bed7-a3c1da106464 with Priority: HIGHEST for action port [ 1136.361049] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_rules [ 1136.361049] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_members [ 1136.361049] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13805cab-1b2c-4c4b-bed7-a3c1da106464 with Priority: HIGHEST for action port [ 1136.361952] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.362287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.362455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.362744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.362983] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.364062] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.364229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.364261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.364439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.364621] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.364724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.364787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.364940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.365040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.365138] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.366494] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-13805cab-1b2c-4c4b-bed7-a3c1da106464 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.366562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.366593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.366737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.366814] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13805cab-1b2c-4c4b-bed7-a3c1da106464',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.868643] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.868958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.868958] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.873022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13805cab-1b2c-4c4b-bed7-a3c1da106464 with status ACTIVE [ 1136.873022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.873022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.873022] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.873022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.873022] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13805cab-1b2c-4c4b-bed7-a3c1da106464 is going to be updated. [ 1136.893679] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.893876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.893933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.894177] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.894310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.894468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13805cab-1b2c-4c4b-bed7-a3c1da106464" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.374144] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.817848] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 in Status: SUCCESS [ 1137.818174] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 deletion is rescheduled due to dependency. [ 1137.818359] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.878882] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.878882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.878882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.878882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.878882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.878882] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe is going to be created. [ 1137.908587] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.908587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.908846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.908934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.910241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.922520] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe in Status: UNINITIALIZED for 2s [ 1139.721686] env[65446]: INFO networking_nsxv3.common.synchronization [req-de960eb2-02d9-4750-8ef6-314f8199cc83 req-e2361142-b9e7-43ea-932f-e2becab5bacd tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1139.722094] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1139.722460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.722668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.722809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.723093] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.725199] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.725365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.725441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.725681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.725946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.725946] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.935773] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe in Status: SUCCESS [ 1139.935773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.935956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.937982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.937982] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.937982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.937982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.937982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.937982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.937982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.937982] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.046881] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.047101] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.047241] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.047530] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.047822] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.047991] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.048687] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.048955] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.049118] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.049322] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.049569] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.049807] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.049863] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.050104] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.050217] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.050366] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.070481] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.070683] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.070826] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.071039] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.071374] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-efbf33c7-a812-4ea7-986c-5ff59eeb6818 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.071573] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.071707] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.072087] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.072248] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efbf33c7-a812-4ea7-986c-5ff59eeb6818',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.228908] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.229011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.229160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.229378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.229499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.229741] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.229868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.229937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.230347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.230347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.230347] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1140.261402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.261593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.262687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.262687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.262687] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.272118] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1140.440047] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.574393] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.574681] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.574815] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.575171] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.575347] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.575506] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port efbf33c7-a812-4ea7-986c-5ff59eeb6818 not found, creating... [ 1140.575837] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.576156] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.576314] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.576585] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.576795] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.577208] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.577380] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.577540] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.577815] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.577978] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.578163] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: efbf33c7-a812-4ea7-986c-5ff59eeb6818 is going to be created. [ 1140.603788] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.604036] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.604193] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.604514] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.604767] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.605038] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.680911] env[65446]: INFO networking_nsxv3.common.synchronization [req-a798957e-da6d-4b71-b27e-42df0d54991e req-3a07065b-8b7a-48a6-9b1c-7fbdcc53450f tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_members [ 1140.681835] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 with Priority: HIGHEST for action security_group_members [ 1140.682407] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c822184-f94c-47e7-a37a-4a1a1df93e39 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.682608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.682732] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.683090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.683353] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.683571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.683642] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.683902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.684080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.684259] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c822184-f94c-47e7-a37a-4a1a1df93e39',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.944278] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e2bc70b-412d-4280-9fad-bebbfedfd5fe: rpc.has_security_group_logging(os_id): False [ 1140.964231] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.964400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.965047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.965047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.965047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.965326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.965426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.965563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.965886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.966075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.966205] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe is going to be created. [ 1141.030648] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.030852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.030907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.031208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.031522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.122111] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe in Status: IN_PROGRESS for 2s [ 1141.186812] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.187024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.187106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.187495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.214631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.214968] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.215301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.215301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.215540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.215633] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.215763] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 is going to be updated. [ 1141.283094] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.283313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.283757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.283836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.284463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.297912] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 in Status: IN_PROGRESS for 2s [ 1141.357081] env[65446]: INFO networking_nsxv3.common.synchronization [req-de960eb2-02d9-4750-8ef6-314f8199cc83 req-031bb1bd-2d24-4890-9399-ca42d6e07669 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1141.357081] env[65446]: INFO networking_nsxv3.common.synchronization [req-de960eb2-02d9-4750-8ef6-314f8199cc83 req-031bb1bd-2d24-4890-9399-ca42d6e07669 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1141.357081] env[65446]: INFO networking_nsxv3.common.synchronization [req-de960eb2-02d9-4750-8ef6-314f8199cc83 req-031bb1bd-2d24-4890-9399-ca42d6e07669 service nova] Enqueued Resource ID: efbf33c7-a812-4ea7-986c-5ff59eeb6818 with Priority: HIGHEST for action port [ 1141.357081] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1141.357081] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1141.357081] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efbf33c7-a812-4ea7-986c-5ff59eeb6818 with Priority: HIGHEST for action port [ 1141.357944] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.358095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.358165] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.358380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.358460] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.359369] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.359559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.359681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-efbf33c7-a812-4ea7-986c-5ff59eeb6818 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.359777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.359841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.360017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.360098] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efbf33c7-a812-4ea7-986c-5ff59eeb6818',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.861695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.861832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.862056] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efbf33c7-a812-4ea7-986c-5ff59eeb6818 with status ACTIVE [ 1141.862228] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.862388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.862510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.862719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.862813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.862989] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.863106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.863156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.863308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.863387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.863572] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.863718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.863886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.864111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.864197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.864338] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efbf33c7-a812-4ea7-986c-5ff59eeb6818 is going to be updated. [ 1141.901839] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.902028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.902028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.902237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.902375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.902533] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efbf33c7-a812-4ea7-986c-5ff59eeb6818" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.285063] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1142.285063] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1142.285426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.285426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.285510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.285729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.285977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.286053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.286295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.286418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.286584] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.790069] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.135342] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe in Status: SUCCESS [ 1143.135342] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.292817] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.308811] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 in Status: SUCCESS [ 1143.309037] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c822184-f94c-47e7-a37a-4a1a1df93e39 deletion is rescheduled due to dependency. [ 1143.309175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c822184-f94c-47e7-a37a-4a1a1df93e39" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.795879] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.796367] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.797026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.797026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.797026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.797026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1143.830427] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.830595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.830686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.831031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.831704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.842251] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1144.796237] env[65446]: INFO networking_nsxv3.common.synchronization [req-5d028421-4a2b-4d6f-971e-d3c80b77c039 req-a81754ef-de9b-49a8-846e-92382e5422e0 tempest-ListServerFiltersTestJSON-498940496 tempest-ListServerFiltersTestJSON-498940496-project-member] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1144.796237] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1144.796237] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.796237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.796237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.796237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.797017] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.797350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.798594] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.800323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.800323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.800323] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.301102] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.811053] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.854553] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1145.854794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.857782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.858024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.858233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.858351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.858412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.858563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.858659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.858742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.858816] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.313510] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.313739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.313739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.313953] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.314050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.314279] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1146.343386] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.343535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.343608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.343819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.343964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.353824] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1146.361366] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.361483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.361604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.361824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.361900] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.361998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.362071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.362213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.362297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.362382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.362628] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.362628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.362730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.362787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.362918] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.363016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.363071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.363205] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.363280] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.363360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.363459] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.866281] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71307925-e0d7-49c9-8bc8-5c5e870d7bca: rpc.has_security_group_logging(os_id): False [ 1146.885863] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.885863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.885863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.886080] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.886110] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.886301] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.886424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.886509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.886670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.886750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.886941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.887055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.887120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.887258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.887352] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.887849] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.887849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.887926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.888025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.888105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.888190] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1146.966077] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.966077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.966077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.966077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.966077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.969907] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1147.643573] env[65446]: INFO networking_nsxv3.common.synchronization [req-c49343ca-e173-43a3-b139-b181b61bb9a3 req-fafb38ad-00cb-4244-bd8a-ddff58dee74c tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1147.644117] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1147.644419] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.644538] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.644608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.644836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.647208] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.647362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.647466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.648231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.648384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.648520] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.987605] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.987922] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.987997] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.988248] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.988508] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.988801] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.988973] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.989253] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.989404] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.989675] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.989796] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.989906] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.990028] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.990142] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.990249] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.990383] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.012760] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.012760] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.012760] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.012760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.012760] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-124674f5-c3d3-4026-89d8-61945a631332 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.013282] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.013439] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.014037] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.014037] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('124674f5-c3d3-4026-89d8-61945a631332',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.154037] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.154259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.154357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.154602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.154721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.154947] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.155102] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.155179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.155333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.155410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.155498] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1148.185697] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.185697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.185979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.186262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.186656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.195983] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1148.363976] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1148.364222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.516513] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.516513] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.516513] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.516707] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.516860] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.517024] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 124674f5-c3d3-4026-89d8-61945a631332 not found, creating... [ 1148.517314] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.517503] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.517768] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.517903] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.518099] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.518435] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.518797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.518868] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.519109] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.519252] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.519436] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 124674f5-c3d3-4026-89d8-61945a631332 is going to be created. [ 1148.540268] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.540492] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.540597] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.540864] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.541097] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.541320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.985209] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1148.985991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.336142] env[65446]: INFO networking_nsxv3.common.synchronization [req-c49343ca-e173-43a3-b139-b181b61bb9a3 req-60709302-1f52-4d91-88f4-cc4f0c71efc7 service nova] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 1149.336477] env[65446]: INFO networking_nsxv3.common.synchronization [req-c49343ca-e173-43a3-b139-b181b61bb9a3 req-60709302-1f52-4d91-88f4-cc4f0c71efc7 service nova] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1149.336477] env[65446]: INFO networking_nsxv3.common.synchronization [req-c49343ca-e173-43a3-b139-b181b61bb9a3 req-60709302-1f52-4d91-88f4-cc4f0c71efc7 service nova] Enqueued Resource ID: 124674f5-c3d3-4026-89d8-61945a631332 with Priority: HIGHEST for action port [ 1149.337101] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 1149.337191] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1149.337565] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124674f5-c3d3-4026-89d8-61945a631332 with Priority: HIGHEST for action port [ 1149.337941] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.338142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.338229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.338456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.338602] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.339817] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.339942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.340424] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-124674f5-c3d3-4026-89d8-61945a631332 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.341439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.341439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.341439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.341439] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('124674f5-c3d3-4026-89d8-61945a631332',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.621438] env[65446]: INFO networking_nsxv3.common.synchronization [None req-cc3d8fc5-58f9-48ab-acda-135cccdfeb94 tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_rules [ 1149.623043] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_rules [ 1149.623043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.623043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.623043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.623043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.623043] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.725315] env[65446]: INFO networking_nsxv3.common.synchronization [None req-d1141178-2757-4b3e-894e-19c8c1057384 tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_rules [ 1149.725857] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_rules [ 1149.726205] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.726306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.843654] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.843654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.843892] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 124674f5-c3d3-4026-89d8-61945a631332 with status ACTIVE [ 1149.844078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.844190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.844255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.844467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.844559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.844727] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.844818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.844902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.845136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.845219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.845409] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.845504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.845567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.845756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.845837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.845925] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 124674f5-c3d3-4026-89d8-61945a631332 is going to be updated. [ 1149.868518] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.868669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.868824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.868997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.869167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.869337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-124674f5-c3d3-4026-89d8-61945a631332" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.145492] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.145736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.145855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.146129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.146350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.146465] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c already deleted. [ 1150.146576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.146734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.146930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.147038] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.206744] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1150.206960] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 deletion is rescheduled due to dependency. [ 1150.207055] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.207215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.207628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.207628] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.207792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.207792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.207907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.207986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.208092] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.667177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.667524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.667524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.667632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.667731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.667810] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c already deleted. [ 1150.667895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.710982] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.215411] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.718101] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.718419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.718419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.718563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.718690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.718812] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1151.750126] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.750330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.750409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.750631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.750826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.763504] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1152.958095] env[65446]: INFO networking_nsxv3.common.synchronization [req-6105fe8c-66c7-415c-8c2c-75c6c6374537 req-006a0e8f-9eee-41fd-821e-0a54fdc81eb4 tempest-ListServerFiltersTestJSON-498940496 tempest-ListServerFiltersTestJSON-498940496-project-member] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1152.958693] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1152.959200] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.959379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.959432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.959903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.959903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.959903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.960253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.960253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.960253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.960433] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.463045] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.777462] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1153.777875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.778242] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.778524] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.778893] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.779118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.779211] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.779365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.779448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.779537] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.779684] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.965049] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.282216] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.468090] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.468090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.468218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.468343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.468470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.468822] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1154.509457] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.509664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.510322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.510322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.510466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.528849] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1154.785026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3905b26b-bddd-4c0d-8d21-44f2dd75c139: rpc.has_security_group_logging(os_id): False [ 1154.805064] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.805329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.805329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.805444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.805480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.805754] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.805855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.805917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.806075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.806159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.806237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1154.867846] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.868145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.868145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.868285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.868429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.887018] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1156.373742] env[65446]: INFO networking_nsxv3.common.synchronization [req-faabf9e7-b539-4987-b75b-6c9bbe4d74ff req-f3adff42-416f-440a-ac7a-15218d1350e2 tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_members [ 1156.374507] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_members [ 1156.374840] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.374990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.377616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.377942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.378694] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.378882] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.378952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.379411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.379411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.379411] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.539856] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1156.539938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.732388] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.732591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.732719] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.733059] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.733350] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.733496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.733616] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.733842] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.734994] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.734994] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.734994] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.734994] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.734994] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.734994] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.734994] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.734994] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.756778] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.756979] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1156.757146] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.757328] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-363" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.757668] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.757860] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.757985] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.758329] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.758471] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.883947] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.884155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.884231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.884449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.884536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.884733] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.884849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.884928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.885140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.885221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.885309] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c already deleted. [ 1156.885392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.900630] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1156.900821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.261170] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.261446] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.261610] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.261951] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.262140] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.262349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b not found, creating... [ 1157.262634] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.262836] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.263403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.263403] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.263518] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.263785] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.263979] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.264117] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.264376] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.264568] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.264737] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b is going to be created. [ 1157.286796] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.287254] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.287516] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.287878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.288279] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.288547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.009190] env[65446]: INFO networking_nsxv3.common.synchronization [req-faabf9e7-b539-4987-b75b-6c9bbe4d74ff req-4a8cf11e-8236-4439-9912-c6ccee22f399 service nova] Enqueued Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_rules [ 1158.009190] env[65446]: INFO networking_nsxv3.common.synchronization [req-faabf9e7-b539-4987-b75b-6c9bbe4d74ff req-4a8cf11e-8236-4439-9912-c6ccee22f399 service nova] Enqueued Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_members [ 1158.009190] env[65446]: INFO networking_nsxv3.common.synchronization [req-faabf9e7-b539-4987-b75b-6c9bbe4d74ff req-4a8cf11e-8236-4439-9912-c6ccee22f399 service nova] Enqueued Resource ID: 4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b with Priority: HIGHEST for action port [ 1158.009541] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_rules [ 1158.009541] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_members [ 1158.009541] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b with Priority: HIGHEST for action port [ 1158.009914] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.010089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.010162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.010373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.010467] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.013223] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.013374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.013445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.013699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.013878] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.013997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.014076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.014473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.014473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.014473] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.016016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.016016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.016016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.016212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.016303] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.518083] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.519241] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.519375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.519671] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b with status ACTIVE [ 1158.519873] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.520051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.520089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.520262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.520350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.520522] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.520613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.520707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.520831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.520913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.521113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.521206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.521528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.521528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.521528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.521528] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b is going to be updated. [ 1158.549020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.549020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.549020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.549222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.549325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.549479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c31dab4-8567-4b37-b8ea-ccd0bc8b9f5b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.020599] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.522962] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.523162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.523204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.523462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.523515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.523618] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c is going to be created. [ 1159.548099] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.548257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.548328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.548598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.548765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.559089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c in Status: UNINITIALIZED for 2s [ 1161.569291] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c in Status: SUCCESS [ 1161.569673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.569673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.569923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.570128] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.570247] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.570313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.570465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.570547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.570632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.570737] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.073035] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.338086] env[65446]: INFO networking_nsxv3.common.synchronization [req-e88db417-668c-4b10-bf2d-5e58ae768dea req-4b231a1d-ce39-4caf-986b-4fe8adca645f tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1162.338902] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1162.338974] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.339106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.339203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.339475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.339666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.339871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.340063] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.340262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.340536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.340681] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.575097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c: rpc.has_security_group_logging(os_id): False [ 1162.593758] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.593918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.593970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.594357] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.594505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.594774] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.594883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.594951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.595266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.595266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.595335] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c is going to be created. [ 1162.657436] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.657603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.657650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.657861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.658281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.669016] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.669234] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.669355] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.669618] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.669929] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.670098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.670216] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.670431] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.670571] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.670813] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.670936] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.671062] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.671193] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.671308] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.671427] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.671561] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.674350] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c in Status: IN_PROGRESS for 2s [ 1162.710679] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.710885] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.711057] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.711243] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.711676] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-05d48383-033f-4ae1-9c40-9bff2527244f taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.711832] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.711878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.712251] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.712394] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d48383-033f-4ae1-9c40-9bff2527244f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.842718] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.842963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.843081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.843316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.867015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.867315] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.867449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.867550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.867850] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.868033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.868086] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1162.909267] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.909458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.909491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.909709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.910135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.919367] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1163.172705] env[65446]: INFO networking_nsxv3.common.synchronization [req-e83c1577-d767-4380-af3f-624c8a26a463 req-be33981f-d463-4965-8522-65d2e342c4e1 tempest-ListServerFiltersTestJSON-498940496 tempest-ListServerFiltersTestJSON-498940496-project-member] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1163.173371] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGHEST for action security_group_members [ 1163.173767] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.173989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.174084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.174336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.174560] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.174726] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.174838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.175221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.175361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.175515] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.214656] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.214887] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.215029] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.215314] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.215463] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.215614] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 05d48383-033f-4ae1-9c40-9bff2527244f not found, creating... [ 1163.216195] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.216195] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.216195] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.216440] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.216594] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.216963] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.217153] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.217280] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.217491] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.217664] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.217799] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 05d48383-033f-4ae1-9c40-9bff2527244f is going to be created. [ 1163.238905] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.239156] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.239156] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.239720] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.239942] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.240425] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.678528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.678806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.678806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.679012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.679116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.679308] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.679408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.679469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.679617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.679692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.679840] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be updated. [ 1163.708975] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.709150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.709221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.709428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.709568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.718533] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: IN_PROGRESS for 2s [ 1163.916231] env[65446]: INFO networking_nsxv3.common.synchronization [req-e88db417-668c-4b10-bf2d-5e58ae768dea req-0048c709-5a88-494d-ac5d-df1cd6cf8efb service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1163.916231] env[65446]: INFO networking_nsxv3.common.synchronization [req-e88db417-668c-4b10-bf2d-5e58ae768dea req-0048c709-5a88-494d-ac5d-df1cd6cf8efb service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1163.916231] env[65446]: INFO networking_nsxv3.common.synchronization [req-e88db417-668c-4b10-bf2d-5e58ae768dea req-0048c709-5a88-494d-ac5d-df1cd6cf8efb service nova] Enqueued Resource ID: 05d48383-033f-4ae1-9c40-9bff2527244f with Priority: HIGHEST for action port [ 1163.916231] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1163.916231] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1163.916231] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d48383-033f-4ae1-9c40-9bff2527244f with Priority: HIGHEST for action port [ 1163.916657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.918023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.918023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.918023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.918023] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.918706] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.918819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.919090] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-05d48383-033f-4ae1-9c40-9bff2527244f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.919250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.919955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.919955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.919955] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d48383-033f-4ae1-9c40-9bff2527244f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.422423] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.422646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.422931] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05d48383-033f-4ae1-9c40-9bff2527244f with status ACTIVE [ 1164.423391] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.423536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.423536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.423826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.424019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.424272] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.424454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.424513] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.424674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.424749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.424942] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.425071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.425144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.425351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.425432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.425536] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05d48383-033f-4ae1-9c40-9bff2527244f is going to be updated. [ 1164.447560] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.447798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.447798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.448048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.448200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.448376] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05d48383-033f-4ae1-9c40-9bff2527244f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.690297] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c in Status: SUCCESS [ 1164.690636] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.931420] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1164.931601] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be deletion is rescheduled due to dependency. [ 1164.931713] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.931885] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.932123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.932324] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.932427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.932484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.932643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.932727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.932820] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.435017] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.729939] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 in Status: SUCCESS [ 1165.730330] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 deletion is rescheduled due to dependency. [ 1165.730330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.937119] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.439822] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.440326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.440786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.441103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.441276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.441396] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1166.482748] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.483035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.483237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.483563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.483779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.495171] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1168.380855] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e63dda5b-b533-417e-81f2-ec8786d13832 tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1168.381430] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1168.381756] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.381861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.506664] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1168.506925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.507269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.507472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.507676] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.507821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.507891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.508066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.508260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.508260] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.508336] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.509983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.509983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.509983] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.509983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.509983] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.510187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.510330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.510367] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.012054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.012054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.012233] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.515100] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.017808] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.017999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.018094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.018320] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.018456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.018498] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1170.049706] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.049900] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.050039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.050209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.050353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.058996] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1170.525725] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.526085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.526085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.527000] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.527000] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.527000] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.527000] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.527172] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.527206] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.527454] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.527565] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.527671] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.527797] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.527930] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.528043] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.528169] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.547292] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.547697] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.547697] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.547807] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.548209] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-8dd0061a-eb16-4239-94a0-b22e047b5505 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.548484] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.548484] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.548757] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.548901] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd0061a-eb16-4239-94a0-b22e047b5505',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.051420] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.051793] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.051793] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.052103] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.052393] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.052393] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 8dd0061a-eb16-4239-94a0-b22e047b5505 not found, creating... [ 1171.052627] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.052777] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.052899] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.053265] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.053427] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.053713] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.053870] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.053987] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.054402] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.054541] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.054701] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 8dd0061a-eb16-4239-94a0-b22e047b5505 is going to be created. [ 1171.076980] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.076980] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.077174] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.077615] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.077680] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.077864] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.791458] env[65446]: INFO networking_nsxv3.common.synchronization [req-c97e4c9d-a360-4946-87a7-429b81fe694c req-9e2653ee-8843-4638-8df0-b284c1f5564b service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1171.792162] env[65446]: INFO networking_nsxv3.common.synchronization [req-c97e4c9d-a360-4946-87a7-429b81fe694c req-9e2653ee-8843-4638-8df0-b284c1f5564b service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1171.792332] env[65446]: INFO networking_nsxv3.common.synchronization [req-c97e4c9d-a360-4946-87a7-429b81fe694c req-9e2653ee-8843-4638-8df0-b284c1f5564b service nova] Enqueued Resource ID: 8dd0061a-eb16-4239-94a0-b22e047b5505 with Priority: HIGHEST for action port [ 1171.792870] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1171.793009] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1171.793132] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd0061a-eb16-4239-94a0-b22e047b5505 with Priority: HIGHEST for action port [ 1171.793418] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.793525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.793725] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.793809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.794020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd0061a-eb16-4239-94a0-b22e047b5505 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.794134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.794189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.794390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.794469] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd0061a-eb16-4239-94a0-b22e047b5505',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.070658] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1172.070873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.071392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.071649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.071852] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.071972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.072048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.072215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.072299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.072369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.072559] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.072659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.072716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.072848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.072983] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.073089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.073139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.073270] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.073362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.073455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.073543] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.074782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.074964] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.075130] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.075237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.075302] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.075461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.075599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.075629] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.297822] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dd0061a-eb16-4239-94a0-b22e047b5505 with status ACTIVE [ 1172.298125] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.298284] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.298381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.298566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.298674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.298858] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.298970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.299012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.299175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.299234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.299414] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.299555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.299555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.299704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.299761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.299839] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dd0061a-eb16-4239-94a0-b22e047b5505 is going to be updated. [ 1172.324057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.324057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.324245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.324358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.324507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.324662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd0061a-eb16-4239-94a0-b22e047b5505" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.577697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e9ab12-2cc1-4bd6-971a-349ffed008be: rpc.has_security_group_logging(os_id): False [ 1172.578782] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.598852] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.599062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.599108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.599300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.599391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.599596] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.599706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.599770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.600023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.600023] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.600248] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.600348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.600410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.600550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.600623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.600801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.600924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.600986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.601144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.601217] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.601303] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1172.663194] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.663412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.663459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.663659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.663804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.678969] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1173.081677] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.583631] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.583813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.583875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.584115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.584207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.584305] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1173.614432] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.614600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.614655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.614864] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.615015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.624708] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1174.695647] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1174.696152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.696152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.696341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.696434] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.198744] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.198960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.636116] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1175.636340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.636501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.636711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.636965] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.637076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.637130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.637233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.637306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.637387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.637475] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.140184] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.140607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.140607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.140794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.141043] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.141043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.141043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.141225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.141869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.141869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.141869] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.141869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.142015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.142182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.142411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.142562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.142706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.142866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.142985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.143125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.143252] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.645367] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e9ab12-2cc1-4bd6-971a-349ffed008be: rpc.has_security_group_logging(os_id): False [ 1176.664217] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.664517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.664517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.664649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.664740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.664948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.665128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.665128] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.665266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.665371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.665600] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.665742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.665838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.665992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.666096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.666353] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.666481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.666573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.666696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.666771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.666858] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1176.732516] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.732789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.732789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.733062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.733238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.745685] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1176.794256] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1176.794438] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1178.762938] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1178.762938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.795885] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1181.796147] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1182.292169] env[65446]: INFO networking_nsxv3.common.synchronization [req-1c2488f1-b526-4e2a-8653-847d98cf9bb3 req-2711f9d8-567f-4a32-a799-022dbd8b5914 tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 1182.292837] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGHEST for action security_group_members [ 1182.293211] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.293381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.293450] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.293980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.294274] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.294388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.294730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.294782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.294887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.295086] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.681494] env[65446]: INFO networking_nsxv3.common.synchronization [req-4f7399ee-664e-40f9-8eeb-c52bc3ab261f req-eec20ab5-c02b-45fc-8ff3-611f36615930 tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1182.683017] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1182.683017] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.683017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.683017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.683017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.683554] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.684022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.684022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.684193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.685064] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.685064] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.798515] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.798929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.798929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.799020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.799056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.799251] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.799368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.799421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.799567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.799711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.799802] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e is going to be updated. [ 1182.831983] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.832193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.832263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.833031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.833031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.841844] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: IN_PROGRESS for 2s [ 1183.187060] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.187238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.187281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.187479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.187567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.187757] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.187855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.187922] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.188120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.188203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.188293] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1183.214573] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.214749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.214806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.214957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.215168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.224922] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1184.303213] env[65446]: INFO networking_nsxv3.common.synchronization [req-b17c03dc-77da-4dc3-8bb2-c7deabce0d8a req-c6ed4ced-7247-4443-ae63-6ba921e4d56b tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1184.303759] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1184.308321] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.308432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.308432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.308819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.308903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.310316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.310316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.310316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.310316] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.310316] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.812633] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.834995] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c710e4b9-1b08-4357-a283-847593dbc3fc tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1184.835326] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1184.835634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.835736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.851693] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b57e5c1-c933-4317-815e-0311cc4e843e in Status: SUCCESS [ 1184.851866] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e deletion is rescheduled due to dependency. [ 1184.851979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.235110] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 4s [ 1185.317705] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.409411] env[65446]: INFO networking_nsxv3.common.synchronization [req-df1a959b-3e7d-4818-b031-d4172b211bd8 req-ff851525-16c5-4a4f-83ee-d2442787c3ab tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1185.409941] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1185.410305] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.410407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.697506] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.697716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.697841] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.698217] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.698494] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.698663] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.698783] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.699013] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.699172] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.699387] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.699502] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.699613] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.699723] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.699834] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.699940] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.700099] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.722841] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.722841] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.722841] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.723045] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-612" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.723320] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-47661742-58ea-49d8-80e4-fcddd113d694 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.723499] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.723621] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.723960] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.724181] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47661742-58ea-49d8-80e4-fcddd113d694',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.819407] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.819535] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.819599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.819805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.819895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.819993] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1185.847151] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.847327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.847368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.847571] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.847710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.856623] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1186.226214] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.226473] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.226603] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.226875] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.227037] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.227195] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 47661742-58ea-49d8-80e4-fcddd113d694 not found, creating... [ 1186.227456] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.227612] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.227733] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.228022] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.228377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.228688] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.228856] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.228981] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.229217] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.229372] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.230278] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 47661742-58ea-49d8-80e4-fcddd113d694 is going to be created. [ 1186.252951] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.253181] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.253314] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.253620] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.253857] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.254302] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.969678] env[65446]: INFO networking_nsxv3.common.synchronization [req-df1a959b-3e7d-4818-b031-d4172b211bd8 req-0b9dfe8d-31e6-465b-841b-6969a4ee5599 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1186.969678] env[65446]: INFO networking_nsxv3.common.synchronization [req-df1a959b-3e7d-4818-b031-d4172b211bd8 req-0b9dfe8d-31e6-465b-841b-6969a4ee5599 service nova] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1186.969678] env[65446]: INFO networking_nsxv3.common.synchronization [req-df1a959b-3e7d-4818-b031-d4172b211bd8 req-0b9dfe8d-31e6-465b-841b-6969a4ee5599 service nova] Enqueued Resource ID: 47661742-58ea-49d8-80e4-fcddd113d694 with Priority: HIGHEST for action port [ 1186.969678] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_rules [ 1186.969678] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1186.969678] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47661742-58ea-49d8-80e4-fcddd113d694 with Priority: HIGHEST for action port [ 1186.969678] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.969678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.969678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.969678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.969678] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.969678] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.969678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.969678] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-47661742-58ea-49d8-80e4-fcddd113d694 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.969678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.969678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.969678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.969678] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47661742-58ea-49d8-80e4-fcddd113d694',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.152322] env[65446]: INFO networking_nsxv3.common.synchronization [None req-42b0f048-5ea0-4d38-a032-e2c629cb529d tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1187.152814] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1187.154366] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.154366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.154366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.154366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.154366] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.230378] env[65446]: INFO networking_nsxv3.common.synchronization [None req-647b2d5c-fa19-41ec-bf6a-a4692b81074e tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1187.230378] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1187.230378] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.230378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.249020] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1187.249020] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1187.249020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.249020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.249020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.249020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.249020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.249020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.249020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.249020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.249020] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.470326] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.470326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.473019] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47661742-58ea-49d8-80e4-fcddd113d694 with status ACTIVE [ 1187.473019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.473019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.473019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.473019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.473019] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47661742-58ea-49d8-80e4-fcddd113d694 is going to be updated. [ 1187.496103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.496103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.496103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.496103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.496103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.496103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47661742-58ea-49d8-80e4-fcddd113d694" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.677765] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.677765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.677765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.677765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.677765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.677765] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402cce96-6e31-494c-bb81-68025c181757 already deleted. [ 1187.677765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.677765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.677765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.677765] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.752521] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.866356] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1187.866567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.866722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.866968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.867156] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.867272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.867333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.867481] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.867561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.867656] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.197414] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.197414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.197414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.197414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.197414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.197414] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402cce96-6e31-494c-bb81-68025c181757 already deleted. [ 1188.197414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.254055] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.370149] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.370295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.370361] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.370582] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.370697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.370903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.371047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.371174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.371406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.371528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.371683] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1188.397188] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.397457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.397528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.397731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.397871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.406974] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1188.757088] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.757282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.757282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.757459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.757568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.757692] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1188.785020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.785249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.785249] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.785462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.785603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.795574] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1190.416618] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1190.416980] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be deletion is rescheduled due to dependency. [ 1190.416980] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.806127] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1190.806329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.806525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.806749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.806947] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.807077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.807152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.807299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.807385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.807553] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.310483] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.814910] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.230566] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1192.230705] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1192.319616] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.319854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.319902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.320169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.320271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.320377] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1192.349659] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.349868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.349913] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.350146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.350314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.360097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1192.812174] env[65446]: INFO networking_nsxv3.common.synchronization [req-6d8d246a-0c67-4260-a390-d5ad40002ae9 req-93631fc2-e1de-465a-8b87-8e317cfbe40d tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1192.812980] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1192.813206] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.813332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.813400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.813661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.813819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.813916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.813978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.814142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.814227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.814321] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.177668] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.178544] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.178544] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.178544] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.178544] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.178705] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.178705] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.178893] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.179053] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.179268] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.179388] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.179508] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.179634] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.179873] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.179873] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.179962] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.199232] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.199407] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.199529] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.199726] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.200056] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-4d242ed2-7baf-4887-aab5-8ce180b5fd44 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.200263] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.200400] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.200727] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.200866] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d242ed2-7baf-4887-aab5-8ce180b5fd44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.316618] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.316879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.316879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.317084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.317175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.317382] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.317483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.317542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.317692] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.317839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.317839] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402cce96-6e31-494c-bb81-68025c181757 already deleted. [ 1193.317981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.386507] env[65446]: INFO networking_nsxv3.common.synchronization [req-104218b6-2db2-457b-b357-104684fc2374 req-9bdf43b2-31be-4a95-afb5-c053917cb99c tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_members [ 1193.387112] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGHEST for action security_group_members [ 1193.387437] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.387574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.387643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.387866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.388037] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.388156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.388221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.389048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.389048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.389048] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.703509] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.703782] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.703950] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.704308] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.704527] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.704740] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 4d242ed2-7baf-4887-aab5-8ce180b5fd44 not found, creating... [ 1193.705124] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.705326] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.705468] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.705731] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.705908] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.706295] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.706505] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.706662] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.706925] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.707123] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.707362] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 is going to be created. [ 1193.727518] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.727734] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.727885] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.728185] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.728418] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.728648] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.891189] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.891405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.891445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.891682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.891778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.891990] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.892101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.892168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.892639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.892639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.892639] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc is going to be updated. [ 1193.923751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.924047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.924047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.924202] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.924344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.933697] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc in Status: IN_PROGRESS for 2s [ 1194.369650] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1194.369952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.369952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.370233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.370429] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.370546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.370597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.370757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.370839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.370924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.371053] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.490335] env[65446]: INFO networking_nsxv3.common.synchronization [req-6d8d246a-0c67-4260-a390-d5ad40002ae9 req-fb1c5e1b-243a-4fae-933a-a4935e898257 service nova] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1194.490830] env[65446]: INFO networking_nsxv3.common.synchronization [req-6d8d246a-0c67-4260-a390-d5ad40002ae9 req-fb1c5e1b-243a-4fae-933a-a4935e898257 service nova] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1194.490830] env[65446]: INFO networking_nsxv3.common.synchronization [req-6d8d246a-0c67-4260-a390-d5ad40002ae9 req-fb1c5e1b-243a-4fae-933a-a4935e898257 service nova] Enqueued Resource ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 with Priority: HIGHEST for action port [ 1194.491408] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1194.491493] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1194.491549] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 with Priority: HIGHEST for action port [ 1194.491870] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.491993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.492356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.492356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.492356] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.493278] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.493390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.493456] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.493647] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.493799] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.494340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.494340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.494340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.494340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.494565] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.495325] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d242ed2-7baf-4887-aab5-8ce180b5fd44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.495478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.495478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.495601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.495674] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d242ed2-7baf-4887-aab5-8ce180b5fd44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.873275] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.873445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.873579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.873722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.873888] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.873991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.874071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.874224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.874311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.874440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.874543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.874637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.874721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.874832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.874968] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.875071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.875132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.875276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.876029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.876029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.876029] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.997666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.997853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.998107] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d242ed2-7baf-4887-aab5-8ce180b5fd44 with status ACTIVE [ 1194.998347] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.998499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.998591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.998880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.999011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.999274] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.999400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.999491] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.999738] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.999792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.000019] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.000083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.000137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.000463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.000911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.000911] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 is going to be updated. [ 1195.001769] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.027542] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.027708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.027777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.027956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.028105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.028552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.378103] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71307925-e0d7-49c9-8bc8-5c5e870d7bca: rpc.has_security_group_logging(os_id): False [ 1195.399229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.399447] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.399566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.399829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.399942] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.400282] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.400434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.400480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.400620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.400720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.400919] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.401024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.401086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.401243] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.401330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.401539] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.401599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.401680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.401826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.401927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.401986] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1195.470580] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.470580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.470580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.470580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.470580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.486611] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1195.505625] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.946174] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc in Status: SUCCESS [ 1195.946174] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc deletion is rescheduled due to dependency. [ 1195.946174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.010342] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.010536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.010631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.010899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.011040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.011192] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402cce96-6e31-494c-bb81-68025c181757 is going to be created. [ 1196.044754] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.045059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.045059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.045191] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.045370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.056723] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: UNINITIALIZED for 2s [ 1197.504906] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1197.505277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.985109] env[65446]: INFO networking_nsxv3.common.synchronization [None req-005d1496-7f3e-429a-92ea-4431edcc5341 tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1197.985109] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1197.985484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.985484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.985634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.985832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.985933] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.066991] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: SUCCESS [ 1198.067228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.067412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.067698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.067894] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.068039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.068112] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.068269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.068350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.068437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.068527] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.091783] env[65446]: INFO networking_nsxv3.common.synchronization [None req-da08d9aa-c0d4-4062-9ab7-5e46ae32e258 tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1198.092312] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1198.092715] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.092835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.137768] env[65446]: INFO networking_nsxv3.common.synchronization [req-eebf1a75-db26-4d71-adb8-73bf5c909607 req-c40175de-4414-4fc2-a9f3-7be618542982 tempest-ServerDiskConfigTestJSON-1559827786 tempest-ServerDiskConfigTestJSON-1559827786-project-member] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1198.137768] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGHEST for action security_group_members [ 1198.137965] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.137965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.138354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.138593] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.138755] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.138860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.138921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.139082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.139182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.139907] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.507472] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.507829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.507829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.507944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.508057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.508164] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e already deleted. [ 1198.508250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.508414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.508550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.508639] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.571525] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.643289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.643657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.643720] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.644108] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.644311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.644681] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.644856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.644991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.645288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.645427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.645565] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be updated. [ 1198.676784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.677021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.677021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.677412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.677563] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.689077] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: IN_PROGRESS for 2s [ 1199.029897] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.030311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.030404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.030696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.030804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.030909] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e already deleted. [ 1199.031507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.073631] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 402cce96-6e31-494c-bb81-68025c181757: rpc.has_security_group_logging(os_id): False [ 1199.093235] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.093419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.093457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.093652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.093742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.093999] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.094115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.094175] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.094326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.094405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.094495] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402cce96-6e31-494c-bb81-68025c181757 is going to be created. [ 1199.161354] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.161541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.161612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.161845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.162053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.173935] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: IN_PROGRESS for 2s [ 1200.698691] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca in Status: SUCCESS [ 1200.699036] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca deletion is rescheduled due to dependency. [ 1200.699036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.185530] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: SUCCESS [ 1201.185775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.651416] env[65446]: INFO networking_nsxv3.common.synchronization [req-e716cd3a-3d43-4c1a-bc5c-65b0c6b5655d req-77190bad-e8da-4c9b-8c83-3eaae1f98d2a tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1202.652075] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1202.652431] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.652651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.652700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.652924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.653177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.653312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.653386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.653652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.653747] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.653889] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.157507] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.157671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.157715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.161020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.180933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.183430] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.183430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.183430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.183430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.183430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.183430] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1203.215836] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.215836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.215836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.215836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.215836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.225740] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1204.588483] env[65446]: INFO networking_nsxv3.common.synchronization [req-14833d9e-41a4-43d6-a42c-3da7764264fb req-8c7f4f9e-6e84-4908-9bf7-af3d4ce948fa tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1204.589592] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1204.590116] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.590332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.590477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.590886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.591178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.591385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.591519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.591794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.591963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.592169] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.913969] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.914152] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.914273] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.914727] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.915010] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.915176] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.915322] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.915586] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.915738] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.915946] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.916073] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.916188] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.916297] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.916411] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.916519] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.916648] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.934922] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.935249] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1204.935396] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.935576] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.935892] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-6ed9c951-b44c-469b-ac99-7fd0d806851b taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.936085] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.936212] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.936589] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.936738] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed9c951-b44c-469b-ac99-7fd0d806851b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.095321] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.095508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.095552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.095765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.095853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.096063] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.096163] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.096225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.096372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.096449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.096540] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e already deleted. [ 1205.096645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.236213] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 4s [ 1205.440399] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.440687] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.440766] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.441113] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.441286] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.441711] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 6ed9c951-b44c-469b-ac99-7fd0d806851b not found, creating... [ 1205.442185] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.442479] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.442794] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.443188] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.443458] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.443965] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.444245] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.444511] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.444822] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.445102] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.445372] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 6ed9c951-b44c-469b-ac99-7fd0d806851b is going to be created. [ 1205.482064] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.482296] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.482340] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.482672] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.482920] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.483184] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.169511] env[65446]: INFO networking_nsxv3.common.synchronization [req-14833d9e-41a4-43d6-a42c-3da7764264fb req-91ccbc07-ff4b-487c-a428-5b608d8fe9bb service nova] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1206.169796] env[65446]: INFO networking_nsxv3.common.synchronization [req-14833d9e-41a4-43d6-a42c-3da7764264fb req-91ccbc07-ff4b-487c-a428-5b608d8fe9bb service nova] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1206.169996] env[65446]: INFO networking_nsxv3.common.synchronization [req-14833d9e-41a4-43d6-a42c-3da7764264fb req-91ccbc07-ff4b-487c-a428-5b608d8fe9bb service nova] Enqueued Resource ID: 6ed9c951-b44c-469b-ac99-7fd0d806851b with Priority: HIGHEST for action port [ 1206.170831] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1206.171017] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1206.171158] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed9c951-b44c-469b-ac99-7fd0d806851b with Priority: HIGHEST for action port [ 1206.171520] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.171779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.171844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.172127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.172237] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.173358] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.173484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.173577] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.173794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.174052] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.174154] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.174207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.174402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.174580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.174653] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.175940] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ed9c951-b44c-469b-ac99-7fd0d806851b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.176105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.176195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.176387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.176501] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed9c951-b44c-469b-ac99-7fd0d806851b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.678724] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.679627] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.679757] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.680410] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ed9c951-b44c-469b-ac99-7fd0d806851b with status ACTIVE [ 1206.680410] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.680410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.680917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.680917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.680917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.680917] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.681091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.681091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.681245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.681369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.681799] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.681799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.681799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.681799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.682171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.682171] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ed9c951-b44c-469b-ac99-7fd0d806851b is going to be updated. [ 1206.703835] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.704034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.704131] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.704410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.704589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.704800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ed9c951-b44c-469b-ac99-7fd0d806851b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.180929] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.251936] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1207.252305] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 deletion is rescheduled due to dependency. [ 1207.252492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.683709] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.683909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.683967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.684226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.684339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.684471] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be created. [ 1207.709048] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.709255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.709255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.709505] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.709696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.720471] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: UNINITIALIZED for 2s [ 1209.733586] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: SUCCESS [ 1209.733924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.733967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.734271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.734408] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.734545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.734670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.734789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.734912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.734997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.735115] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.238060] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.740690] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7232f86f-8f31-43de-aad8-e42a48d1755e: rpc.has_security_group_logging(os_id): False [ 1210.758319] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.758504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.758504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.758723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.758845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.759116] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.759246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.759305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.759428] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.759512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.759576] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be created. [ 1210.826933] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.827136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.827181] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.827374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.827554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.838444] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: IN_PROGRESS for 2s [ 1211.172468] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.172594] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1212.852712] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: SUCCESS [ 1212.853084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.601825] env[65446]: INFO networking_nsxv3.common.synchronization [req-d9dcf576-cce6-4b76-ac30-d6f833e5342f req-549e9b33-c002-4f0f-bcd3-d6e1b8e29e49 tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1213.602321] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1213.602644] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.602769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.602835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.603066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.603241] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.603373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.603418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.603569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.603655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.603749] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.892692] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.893039] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.893109] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.893394] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.893653] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.893825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.894019] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.894262] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.894484] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.894826] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1213.895052] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1213.895260] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1213.895460] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1213.895617] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1213.895754] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1213.895896] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1213.915043] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1213.915229] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1213.915369] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1213.915548] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.915846] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.916025] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.916148] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.916460] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.916600] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f278f3c0-68ed-420a-ae5b-177ebc4e9db7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.107038] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.107038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.107038] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.107271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.107271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.107447] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.107546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.107596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.107751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.107838] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.107924] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1214.133841] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.134047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.134047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.134248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.134385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.142776] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1214.420101] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.420340] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.420507] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.420856] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.421041] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.421216] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port f278f3c0-68ed-420a-ae5b-177ebc4e9db7 not found, creating... [ 1214.421488] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.421656] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.421774] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.421997] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.422153] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.422437] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.422595] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.422714] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.422966] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.423119] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.423262] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: f278f3c0-68ed-420a-ae5b-177ebc4e9db7 is going to be created. [ 1214.442252] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.442462] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.442834] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.442922] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.443135] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.443354] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.142021] env[65446]: INFO networking_nsxv3.common.synchronization [req-d9dcf576-cce6-4b76-ac30-d6f833e5342f req-ed9da848-0b47-4dd1-9282-c75b560d320a service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1215.142021] env[65446]: INFO networking_nsxv3.common.synchronization [req-d9dcf576-cce6-4b76-ac30-d6f833e5342f req-ed9da848-0b47-4dd1-9282-c75b560d320a service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1215.142021] env[65446]: INFO networking_nsxv3.common.synchronization [req-d9dcf576-cce6-4b76-ac30-d6f833e5342f req-ed9da848-0b47-4dd1-9282-c75b560d320a service nova] Enqueued Resource ID: f278f3c0-68ed-420a-ae5b-177ebc4e9db7 with Priority: HIGHEST for action port [ 1215.142021] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1215.142021] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1215.142021] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f278f3c0-68ed-420a-ae5b-177ebc4e9db7 with Priority: HIGHEST for action port [ 1215.142021] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.142021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.142021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.142021] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.142021] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.143740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.143957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.144258] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.144559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.144698] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.144936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.145101] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f278f3c0-68ed-420a-ae5b-177ebc4e9db7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.647198] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.647343] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.651385] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f278f3c0-68ed-420a-ae5b-177ebc4e9db7 with status ACTIVE [ 1215.651385] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.651385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.651385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.651385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.651752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.651752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.651821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.651849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.652020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.652109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.652545] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.653262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.653262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.653262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.653262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.653262] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f278f3c0-68ed-420a-ae5b-177ebc4e9db7 is going to be updated. [ 1215.675888] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.675888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.675888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.676244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.676244] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.676369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f278f3c0-68ed-420a-ae5b-177ebc4e9db7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.155047] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1216.155394] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 deletion is rescheduled due to dependency. [ 1216.155394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.155490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.155694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.155877] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.155990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.156070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.156220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.156298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.156392] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.658856] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.162962] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.667463] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.667463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.667463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.667463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.667463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.667463] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1217.696467] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.696707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.696707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.697148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.697304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.707975] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1219.722320] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1219.722756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.722756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.722945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.723382] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.723623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.723737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.723947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.724187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.724187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.724368] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.142017] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.142165] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1220.226834] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.729663] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1358f1df-64ea-4b5e-909f-92bef5099bf1: rpc.has_security_group_logging(os_id): False [ 1220.749271] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.749469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.749516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.749701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.749793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.750055] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.750155] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.750210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.750365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.750441] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.750555] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1220.812973] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.813255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.813323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.813558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.813746] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.829115] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1222.721637] env[65446]: INFO networking_nsxv3.common.synchronization [req-92931b39-e222-4730-bae8-49095d3fef70 req-cb96780e-ee01-41b8-aea5-56d0811c2a56 tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1222.722241] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1222.722561] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.722695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.722778] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.723022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.723194] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.723322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.723353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.723512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.723648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.723825] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.846015] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1222.846015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.040363] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.040606] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.040783] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.041166] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.041459] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.041679] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.041803] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.042097] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.042245] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.042493] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1223.042603] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1223.042716] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1223.042876] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1223.043011] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1223.043122] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1223.043255] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1223.065883] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1223.066143] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1223.066318] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1223.066547] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.066924] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-5cb4039f-22ca-41f6-937c-c2541090e584 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.067169] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.067338] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.067730] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.067909] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cb4039f-22ca-41f6-937c-c2541090e584',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.227417] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.571044] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.571044] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.571268] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.571624] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.571624] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.571815] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 5cb4039f-22ca-41f6-937c-c2541090e584 not found, creating... [ 1223.571947] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.572124] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.572243] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.572459] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.572706] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.574989] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.574989] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.574989] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.574989] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.574989] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.574989] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 5cb4039f-22ca-41f6-937c-c2541090e584 is going to be created. [ 1223.594575] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.594664] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.594812] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.595341] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.595632] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.595938] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.729991] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.232672] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.232883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.232883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.233050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.233147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.233248] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be updated. [ 1224.264812] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.265655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.265655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.265655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.265655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.275942] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: IN_PROGRESS for 2s [ 1224.296074] env[65446]: INFO networking_nsxv3.common.synchronization [req-92931b39-e222-4730-bae8-49095d3fef70 req-1ff2ccc7-a3b5-42bc-b166-fb601be79bc3 service nova] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1224.296376] env[65446]: INFO networking_nsxv3.common.synchronization [req-92931b39-e222-4730-bae8-49095d3fef70 req-1ff2ccc7-a3b5-42bc-b166-fb601be79bc3 service nova] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1224.296542] env[65446]: INFO networking_nsxv3.common.synchronization [req-92931b39-e222-4730-bae8-49095d3fef70 req-1ff2ccc7-a3b5-42bc-b166-fb601be79bc3 service nova] Enqueued Resource ID: 5cb4039f-22ca-41f6-937c-c2541090e584 with Priority: HIGHEST for action port [ 1224.297145] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_rules [ 1224.297279] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1224.297377] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb4039f-22ca-41f6-937c-c2541090e584 with Priority: HIGHEST for action port [ 1224.297664] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.297786] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.297855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.298065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.298148] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.299104] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.299240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.299391] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cb4039f-22ca-41f6-937c-c2541090e584 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.299494] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.299539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.299761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.299849] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cb4039f-22ca-41f6-937c-c2541090e584',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.801867] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.802360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.803402] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cb4039f-22ca-41f6-937c-c2541090e584 with status ACTIVE [ 1224.803593] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.803716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.803828] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.804016] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.804096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.804268] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.804366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.804426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.804570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.804671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.804833] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.804927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.804993] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.805148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.805210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.805299] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cb4039f-22ca-41f6-937c-c2541090e584 is going to be updated. [ 1224.828688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.828904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.828904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.829133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.829272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.829445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cb4039f-22ca-41f6-937c-c2541090e584" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.290225] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: SUCCESS [ 1226.290225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.290225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.290225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.290694] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.290694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.290694] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.290842] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.290932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.291084] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.793313] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.295460] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.797730] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.797883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.797947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.798186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.798276] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.798380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be updated. [ 1227.826457] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.826640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.826684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.826869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.827030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.835486] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: IN_PROGRESS for 2s [ 1229.298845] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1229.299282] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1229.846963] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: SUCCESS [ 1229.847123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.847288] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.847522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.847742] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.847874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.847957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.848132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.848216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.848300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.848388] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.351228] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.857067] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7232f86f-8f31-43de-aad8-e42a48d1755e: rpc.has_security_group_logging(os_id): False [ 1230.875178] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.875355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.875355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.875567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.875670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.876066] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.876241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.876353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.876845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.876845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.876952] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be updated. [ 1230.935814] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.936011] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.936076] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.936286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.936437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.949479] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: IN_PROGRESS for 2s [ 1231.168126] env[65446]: INFO networking_nsxv3.common.synchronization [req-3e0330de-a3c7-4697-b51b-5194b3fcd3c7 req-9905f047-c1be-4724-9fb9-d45fd15d4a9d tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1231.168126] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1231.168126] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.168126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.168126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.168410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.168673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.168673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.168673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.168855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.168896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.168982] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.673055] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.673388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.673388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.673530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.673618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.673819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.673917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.673979] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.674144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.674219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.674306] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1231.704316] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.704531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.704531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.704705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.704841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.713563] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1232.965778] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: SUCCESS [ 1232.966363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.265154] env[65446]: INFO networking_nsxv3.common.synchronization [None req-a530a651-4686-487c-a9e6-ef92b968e7fc tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1233.265477] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1233.265842] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.266031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.266424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.266899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.267463] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.267653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.267826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.268129] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.268251] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.268449] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.724457] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1233.724648] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 deletion is rescheduled due to dependency. [ 1233.724847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.773017] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.773198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.773267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.773506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.773598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.773801] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.773902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.773963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.774149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.774230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.774336] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1233.776176] env[65446]: INFO networking_nsxv3.common.synchronization [req-b1b80973-7a51-48a6-a9a6-664008d6be9d req-33c8ce66-82d5-4d37-a2e5-d15818023fe5 tempest-AttachVolumeTestJSON-822850982 tempest-AttachVolumeTestJSON-822850982-project-member] Enqueued Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_members [ 1233.776731] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGHEST for action security_group_members [ 1233.777459] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.777572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.777638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.777807] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.777972] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.778095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.778162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.778314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.778395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.778489] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.803837] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.804043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.804083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.804272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.804411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.813324] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1234.280598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.281017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.281017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.281416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.281416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.281532] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.281532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.281623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.281918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.282033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.282136] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c is going to be updated. [ 1234.311306] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.311496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.311590] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.311873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.312077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.321023] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c in Status: IN_PROGRESS for 2s [ 1235.824074] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1235.824074] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be deletion is rescheduled due to dependency. [ 1235.824074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.335138] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c in Status: SUCCESS [ 1236.335387] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c deletion is rescheduled due to dependency. [ 1236.335517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.777982] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1238.778285] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.072430] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d1c7ff6-a107-4b80-be25-04f71077b984 req-bd9cb203-bbbd-4935-9ee9-ab8f92af4622 tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1240.072970] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1240.073289] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.073409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.073469] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.073664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.073806] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.073903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.073960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.074120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.074201] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.074295] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.383948] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.384173] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.384323] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.384623] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.384910] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.385096] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.385219] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.385466] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.385617] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.385823] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.385952] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.386076] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.386213] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.386322] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.386435] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.386598] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.405959] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.406154] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1240.406322] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.406516] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-463" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.406817] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.407021] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.407154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.407463] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.407635] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.577273] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.577436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.577507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.577734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.577829] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.578039] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.578144] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.578203] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.578348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.578425] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.578507] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1240.606142] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.606142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.606142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.606142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.606142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.615089] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1240.910223] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.910474] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.910608] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.910979] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.911144] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.911341] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 not found, creating... [ 1240.911654] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.911825] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.911961] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.912279] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.912434] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.912731] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.912884] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.913020] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.913235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.913409] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.913564] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 is going to be created. [ 1240.939376] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.939595] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.939702] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.939981] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.940230] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.940456] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.648101] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d1c7ff6-a107-4b80-be25-04f71077b984 req-80f31bd6-75a9-42ef-b07c-8a4310e95a90 service nova] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 1241.648462] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d1c7ff6-a107-4b80-be25-04f71077b984 req-80f31bd6-75a9-42ef-b07c-8a4310e95a90 service nova] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1241.648462] env[65446]: INFO networking_nsxv3.common.synchronization [req-2d1c7ff6-a107-4b80-be25-04f71077b984 req-80f31bd6-75a9-42ef-b07c-8a4310e95a90 service nova] Enqueued Resource ID: 5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 with Priority: HIGHEST for action port [ 1241.648605] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_rules [ 1241.648761] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1241.648971] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 with Priority: HIGHEST for action port [ 1241.649405] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.649534] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.649595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.649781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.649866] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.651110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.651215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.652029] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.652029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.652029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.652029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.652029] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.153706] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.153941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.154065] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 with status ACTIVE [ 1242.154197] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.154310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.154377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.154597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.154685] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.154853] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.154952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.155015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.155171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.155293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.155425] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.155507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.155601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.155699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.155773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.155858] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0 is going to be updated. [ 1242.182528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.182721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.182721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.182921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.183078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.183231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d1b5566-aad5-4e70-8fec-3eb9e2fb4af0" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.625068] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1242.625287] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 deletion is rescheduled due to dependency. [ 1242.625382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.625555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.625870] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.626100] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.626293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.626293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.626436] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.626516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.626613] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.128927] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.631322] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.134305] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.134731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.134731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.134843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.134950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.135065] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1244.168969] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.169190] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.169308] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.169644] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.169866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.179765] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1246.192262] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1246.192605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.192605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.192832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.193024] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.193146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.193209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.193353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.193432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.193516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.193606] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.649814] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.649814] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1246.695475] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.198195] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3905b26b-bddd-4c0d-8d21-44f2dd75c139: rpc.has_security_group_logging(os_id): False [ 1247.217577] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.217796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.217796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.217941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.218039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.218290] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.218394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.218460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.218683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.218683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.218831] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1247.302162] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.302386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.302432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.302663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.302814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.322652] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1249.341174] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1249.341465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.651273] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1251.651692] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1255.564074] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1255.564431] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1256.652625] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1256.653120] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.990916] env[65446]: INFO networking_nsxv3.common.synchronization [req-23709758-ea0c-4f2d-a465-437c2ee4a6a4 req-c433cdaa-2017-40de-adb9-8f414dbc2b2d tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_members [ 1258.991389] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGHEST for action security_group_members [ 1258.991645] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.991770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.991837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.992085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.992250] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.992353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.992416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.992989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.992989] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.992989] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.495291] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.495507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.495507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.495731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.495821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.496033] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.496138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.496223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.496348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.496424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.496509] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe is going to be updated. [ 1259.527143] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.527297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.527368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.527580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.527725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.538114] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe in Status: IN_PROGRESS for 2s [ 1261.560768] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe in Status: SUCCESS [ 1261.560768] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe deletion is rescheduled due to dependency. [ 1261.560768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.986987] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.987205] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.987379] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.987732] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.988142] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.988357] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.988415] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.988656] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.988821] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.989114] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1261.989291] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1261.989416] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1261.989537] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1261.989674] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1261.989784] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1261.989916] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.014904] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.015199] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1262.015366] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.015559] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.015913] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-2c6430b7-f4e9-4776-b5c8-5def971e09a4 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.016126] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.016272] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.016631] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.016778] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6430b7-f4e9-4776-b5c8-5def971e09a4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.518971] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.519242] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.519242] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.519434] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.519597] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.519754] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 2c6430b7-f4e9-4776-b5c8-5def971e09a4 not found, creating... [ 1262.520025] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.520190] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.520316] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.520542] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.520681] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.520982] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.521191] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.521311] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.521529] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.521665] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.521808] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 is going to be created. [ 1262.542956] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.543215] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.543313] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.543620] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.543853] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.544090] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.284796] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c52c4fb-a4a6-48b3-b7f9-7ec000ac8da8 req-95a3c4ea-8ed8-40c7-91a6-b0269f24a461 service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1263.285139] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c52c4fb-a4a6-48b3-b7f9-7ec000ac8da8 req-95a3c4ea-8ed8-40c7-91a6-b0269f24a461 service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1263.285139] env[65446]: INFO networking_nsxv3.common.synchronization [req-7c52c4fb-a4a6-48b3-b7f9-7ec000ac8da8 req-95a3c4ea-8ed8-40c7-91a6-b0269f24a461 service nova] Enqueued Resource ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 with Priority: HIGHEST for action port [ 1263.285994] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1263.285994] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1263.285994] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 with Priority: HIGHEST for action port [ 1263.286569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.286569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.286569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.286569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.286569] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.287778] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.287901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.287976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.288133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.288283] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.288383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.288446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.288589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.288670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.288786] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.289528] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c6430b7-f4e9-4776-b5c8-5def971e09a4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.289725] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.290985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.290985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.291766] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6430b7-f4e9-4776-b5c8-5def971e09a4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.792645] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.794498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.794836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.795035] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c6430b7-f4e9-4776-b5c8-5def971e09a4 with status ACTIVE [ 1263.795231] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.795351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.795422] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.795625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.795711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.796029] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.796140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.796200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.796362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.796424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.796634] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.796730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.796785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.796927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.796999] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.797097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 is going to be updated. [ 1263.817103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.817332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.817332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.817550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.817695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.817847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.295695] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.801955] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.802220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.802292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.802510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.802601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.802699] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1264.832311] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.832311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.832311] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.832514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.832549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.841117] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1266.853428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1266.853731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.853808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.854032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.854233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.854356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.854423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.854572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.854651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.854734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.854817] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.357445] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.357678] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.357727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.357940] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.358153] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.358262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.358327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.358485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.358575] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.358670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.358859] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.358967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.359099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.359263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.359404] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.359495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.359554] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.359690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.359766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.359847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.359936] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.862421] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e9ab12-2cc1-4bd6-971a-349ffed008be: rpc.has_security_group_logging(os_id): False [ 1267.879267] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.879479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.879479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.879674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.879766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.879944] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.880053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.880109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.880252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.880327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.880524] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.880619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.880683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.880825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.880898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.881101] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.881206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.881326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.881412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.881486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.881572] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1267.940254] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.940460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.940460] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.940625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.940767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.957165] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1268.287565] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.287800] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1269.974597] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1269.974965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.586395] env[65446]: INFO networking_nsxv3.common.synchronization [req-5916e77d-e217-45db-87c2-4c645ae8efc9 req-1c757293-8e60-40f2-ac53-e348c9a90058 tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1271.586657] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1271.586795] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.586866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.586919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.587127] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.587283] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.587383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.587442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.587621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.587710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.587802] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.902513] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.902715] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.902849] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.903189] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.903453] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.903613] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.903732] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.903945] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.904103] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.904318] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.904493] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.904613] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.904724] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.904841] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.904949] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.905094] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.924284] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.924434] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1271.924583] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.924768] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.925093] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.925299] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.925433] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.925757] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.925898] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77c5f24c-79a8-4f46-bbd0-ab37a7817c68',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.089702] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.089954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.090039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.090278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.090378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.090600] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.090708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.090773] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.090935] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.091030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.091229] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be updated. [ 1272.124969] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.125266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.125266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.125408] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.125549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.134449] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: IN_PROGRESS for 2s [ 1272.428224] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.428463] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.428578] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.428857] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.429023] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.429202] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 not found, creating... [ 1272.429480] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.429651] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.429765] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.429977] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.430128] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.430403] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.430554] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.430667] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.430868] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.430998] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.431179] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 is going to be created. [ 1272.450360] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.450574] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.450700] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.450960] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.451278] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.451496] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.158357] env[65446]: INFO networking_nsxv3.common.synchronization [req-5916e77d-e217-45db-87c2-4c645ae8efc9 req-0fa2c722-d780-4d52-bd20-d5483be1bffd service nova] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_rules [ 1273.158599] env[65446]: INFO networking_nsxv3.common.synchronization [req-5916e77d-e217-45db-87c2-4c645ae8efc9 req-0fa2c722-d780-4d52-bd20-d5483be1bffd service nova] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1273.158676] env[65446]: INFO networking_nsxv3.common.synchronization [req-5916e77d-e217-45db-87c2-4c645ae8efc9 req-0fa2c722-d780-4d52-bd20-d5483be1bffd service nova] Enqueued Resource ID: 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 with Priority: HIGHEST for action port [ 1273.159221] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_rules [ 1273.159942] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1273.160194] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 with Priority: HIGHEST for action port [ 1273.160536] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.160716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.160821] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.161067] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.161219] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.162529] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.162709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.162973] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.163138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.163240] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.163454] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.163574] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77c5f24c-79a8-4f46-bbd0-ab37a7817c68',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.663378] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.663630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.668032] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 with status ACTIVE [ 1273.668219] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.668355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.668423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.668638] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.668730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.668909] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.669042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.669160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.669271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.669348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.669580] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.669667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.669705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.669841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.669918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.670010] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 is going to be updated. [ 1273.692187] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.692405] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.692465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.692674] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.692811] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.692970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.145094] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: SUCCESS [ 1274.145270] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 deletion is rescheduled due to dependency. [ 1274.146027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.146027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.146027] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.146027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.146261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.146261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.146261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.146364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.146437] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.298431] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.298797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.298797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.299051] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.299359] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.299529] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.299648] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.299872] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.300049] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.300247] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.300363] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.300474] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.300582] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.300691] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.300799] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.300933] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.319744] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.319933] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.320066] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.320249] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-209" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.320567] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-4d242ed2-7baf-4887-aab5-8ce180b5fd44 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.320741] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.320862] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.321156] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.321358] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d242ed2-7baf-4887-aab5-8ce180b5fd44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.649078] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.823745] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.823968] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.824097] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.824371] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.824531] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.824829] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.824990] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.825125] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.825343] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.825481] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.825799] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.826072] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.826269] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.826499] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.826638] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.826784] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 is going to be updated. [ 1274.846682] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.846933] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.846994] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.847253] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.847444] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.847659] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.151762] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.794384] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.794384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.794384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.794384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.794384] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.794384] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be updated. [ 1275.827985] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.828140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.828209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.828418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.828559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.838158] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: IN_PROGRESS for 2s [ 1275.994884] env[65446]: INFO networking_nsxv3.common.synchronization [req-f46a77a1-5b35-4395-a069-351d77a0edb6 req-e79d8b9a-2b63-4849-a364-017c3851b3b8 service nova] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1275.995084] env[65446]: INFO networking_nsxv3.common.synchronization [req-f46a77a1-5b35-4395-a069-351d77a0edb6 req-e79d8b9a-2b63-4849-a364-017c3851b3b8 service nova] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1275.995232] env[65446]: INFO networking_nsxv3.common.synchronization [req-f46a77a1-5b35-4395-a069-351d77a0edb6 req-e79d8b9a-2b63-4849-a364-017c3851b3b8 service nova] Enqueued Resource ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 with Priority: HIGHEST for action port [ 1275.995737] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_rules [ 1275.995871] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1275.995953] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 with Priority: HIGHEST for action port [ 1275.996320] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.996449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.996515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.996707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.996788] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.998224] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.998224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.998224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.998224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.998224] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.998224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.998224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.998484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.998484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.998484] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.999200] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d242ed2-7baf-4887-aab5-8ce180b5fd44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.999307] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.999374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.999522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.999595] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d242ed2-7baf-4887-aab5-8ce180b5fd44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.501422] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.502534] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.502645] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.502803] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d242ed2-7baf-4887-aab5-8ce180b5fd44 with status ACTIVE [ 1276.502960] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.503077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.503142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.503351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.503439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.503609] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.503704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.503764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.503907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.503984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.504175] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.504330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.504330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.504458] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.504532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.504616] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d242ed2-7baf-4887-aab5-8ce180b5fd44 is going to be updated. [ 1276.529839] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.529839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.529839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.529839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.529839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.529839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d242ed2-7baf-4887-aab5-8ce180b5fd44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.006798] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.509777] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.509945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.510077] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.510299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.510394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.510474] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402cce96-6e31-494c-bb81-68025c181757 is going to be updated. [ 1277.547382] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.547552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.547626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.547823] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.547965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.558202] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: IN_PROGRESS for 2s [ 1277.848439] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: SUCCESS [ 1277.848439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.848439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.848439] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.848619] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.848727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.848789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.848938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.849028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.849118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.849287] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.352472] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.352880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.352880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.352880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.353062] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.353169] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.353231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.353365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.353424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.353599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.353740] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.353834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.353884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.354039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.354204] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.354290] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.354372] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.354484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.354626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.354626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.354760] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.856999] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b114036a-38e3-4f81-b1f6-91a83ad71c82: rpc.has_security_group_logging(os_id): False [ 1278.873752] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.873911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.873972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.874209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.874301] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.874519] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.874619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.874683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.874832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.874907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.875103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.875199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.875261] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.875397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.875468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.875684] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.875781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.875843] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.875982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.876096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.876184] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be updated. [ 1278.972052] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.972233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.972330] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.972565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.972744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.985582] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: IN_PROGRESS for 2s [ 1279.569144] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: SUCCESS [ 1279.569466] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.570062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.570062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.570062] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.570286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.570286] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.570435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.570536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.570618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.570711] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.073475] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.279940] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.280221] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.280356] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.280722] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.281061] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.281282] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.281461] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.281707] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.281922] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.282179] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.282318] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.282481] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.282614] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.282758] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.282896] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.283052] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.303106] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.303448] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1280.303689] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.304012] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-113" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.304382] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-2c6430b7-f4e9-4776-b5c8-5def971e09a4 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.304674] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.304878] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.305176] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.305316] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6430b7-f4e9-4776-b5c8-5def971e09a4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.575413] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 402cce96-6e31-494c-bb81-68025c181757: rpc.has_security_group_logging(os_id): False [ 1280.601887] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.602103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.602103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.602370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.602479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.602898] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.603034] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.603153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.604030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.604030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.604030] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402cce96-6e31-494c-bb81-68025c181757 is going to be updated. [ 1280.694643] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.694887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.694968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.695272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.695426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.712776] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: IN_PROGRESS for 2s [ 1280.808112] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.808477] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.808698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.809153] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.809409] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.809856] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.810186] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.810280] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.810623] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.810833] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.811370] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.811591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.811760] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.812068] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.812235] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.812386] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 is going to be updated. [ 1280.841256] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.841479] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.841590] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.841910] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.842077] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.842435] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.996937] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.996937] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1281.002775] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: SUCCESS [ 1281.002775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.313024] env[65446]: INFO networking_nsxv3.common.synchronization [req-c03a6e68-e65f-4478-8c6f-d5b9d6319585 req-e68a3e47-c3eb-46eb-80e7-4dd1ab4d8dbf tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1281.313024] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGHEST for action security_group_members [ 1281.313816] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.314164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.314329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.315133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.315133] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.315133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.315133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.315324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.315324] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.315419] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.364406] env[65446]: INFO networking_nsxv3.common.synchronization [req-c03a6e68-e65f-4478-8c6f-d5b9d6319585 req-e68a3e47-c3eb-46eb-80e7-4dd1ab4d8dbf tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 with Priority: HIGHEST for action port [ 1281.364989] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 with Priority: HIGHEST for action port [ 1281.366094] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.366094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.366094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.366523] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.366586] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77c5f24c-79a8-4f46-bbd0-ab37a7817c68',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.554428] env[65446]: INFO networking_nsxv3.common.synchronization [req-a1b7dc98-db63-4932-b232-23379b06b6de req-be174b53-317f-4c92-8ac7-975f48af41b3 service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1281.554657] env[65446]: INFO networking_nsxv3.common.synchronization [req-a1b7dc98-db63-4932-b232-23379b06b6de req-be174b53-317f-4c92-8ac7-975f48af41b3 service nova] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1281.554816] env[65446]: INFO networking_nsxv3.common.synchronization [req-a1b7dc98-db63-4932-b232-23379b06b6de req-be174b53-317f-4c92-8ac7-975f48af41b3 service nova] Enqueued Resource ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 with Priority: HIGHEST for action port [ 1281.555337] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_rules [ 1281.555509] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1281.555651] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 with Priority: HIGHEST for action port [ 1281.556042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.557222] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.557303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.557504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.557591] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.559553] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.559844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.559944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.560200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.560704] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.560875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.560972] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.561162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.561297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.561547] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.563779] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c6430b7-f4e9-4776-b5c8-5def971e09a4 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.563946] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.563998] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.564213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.564298] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6430b7-f4e9-4776-b5c8-5def971e09a4',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.817938] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.818278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.818278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.818443] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.818487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.818708] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.818868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.818868] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.819179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.819179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.819335] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be updated. [ 1281.852954] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.853115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.853199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.853433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.853605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.863152] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: IN_PROGRESS for 2s [ 1281.869889] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 with status ACTIVE [ 1281.869889] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.869889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.870133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.870198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.870291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.871057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.871057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.871057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.871057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.871057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.871394] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.871394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.871394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.871507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.871540] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.871610] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77c5f24c-79a8-4f46-bbd0-ab37a7817c68 is going to be updated. [ 1281.897384] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.897526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.897597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.897982] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.898156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.898472] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77c5f24c-79a8-4f46-bbd0-ab37a7817c68" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.060977] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.060977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.064430] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.067805] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c6430b7-f4e9-4776-b5c8-5def971e09a4 with status ACTIVE [ 1282.067805] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.067805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.067805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.068069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.068069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.068239] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.068336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.068395] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.068559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.068634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.068811] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.068898] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.068957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.069124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.069196] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.069277] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c6430b7-f4e9-4776-b5c8-5def971e09a4 is going to be updated. [ 1282.095923] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.096123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.096168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.096366] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.096508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.096683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c6430b7-f4e9-4776-b5c8-5def971e09a4" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.567075] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.728735] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: SUCCESS [ 1282.729017] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.069284] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.069716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.069716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.069962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.070073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.070133] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1283.115677] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.115883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.116044] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.116194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.116403] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.129637] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1283.874724] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 in Status: SUCCESS [ 1283.874949] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 deletion is rescheduled due to dependency. [ 1283.875083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.143034] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1285.143459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.143459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.143675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.143886] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.144019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.144088] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.144253] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.144333] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.144426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.144519] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.646751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.647050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.647050] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.647213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.647460] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.647643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.647719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.647916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.648060] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.648208] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.648408] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.648529] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.648665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.648854] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.649010] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.649120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.649206] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.649380] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.649463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.649546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.649666] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.152543] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3e9ab12-2cc1-4bd6-971a-349ffed008be: rpc.has_security_group_logging(os_id): False [ 1286.171903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.172135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.172135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.172418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.172515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.172712] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.172812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.172876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.173040] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.173118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.173324] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.173419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.173482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.173622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.173695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.173869] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.173961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.174037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.174178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.174305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.174352] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be updated. [ 1286.231069] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.231226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.231358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.231585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.231736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.248773] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: IN_PROGRESS for 2s [ 1286.557263] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.557461] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1288.270937] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be in Status: SUCCESS [ 1288.271518] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.558845] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.559191] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.560668] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.560668] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.562096] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.562096] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1302.371614] env[65446]: INFO networking_nsxv3.common.synchronization [req-a7a733e7-b41d-4136-af21-1cd7d011cb4e req-a107b193-896a-4c9e-863f-60d9169093e3 tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1302.372164] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1302.372484] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.372617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.372684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.372879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.373065] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.373168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.373232] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.373390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.373722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.373845] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.876012] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.381416] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.490630] env[65446]: INFO networking_nsxv3.common.synchronization [req-734a67c4-3394-495e-a2c6-e431bbf8e18f req-f56fd175-8d83-45b4-994b-8d5178c412f1 tempest-ServerActionsTestJSON-498869852 tempest-ServerActionsTestJSON-498869852-project-member] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1303.492301] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGHEST for action security_group_members [ 1303.493024] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.493254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.493254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.493572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.493821] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.493902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.493951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.495306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.495306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.495306] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.883506] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.883948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.883948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.883948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.884085] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.884155] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be updated. [ 1303.913445] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.913661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.913703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.914223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.914223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.922599] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: IN_PROGRESS for 2s [ 1303.998390] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.998581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.998658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.998873] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.998963] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.999175] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.999273] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.999379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.999484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.999559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.999649] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be updated. [ 1304.034306] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.034471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.034471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.034832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.034992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.043122] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: IN_PROGRESS for 2s [ 1305.932073] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: SUCCESS [ 1305.932328] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.054026] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 in Status: SUCCESS [ 1306.054356] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 deletion is rescheduled due to dependency. [ 1306.054561] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.514057] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.514227] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.514292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.514515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.514629] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.016556] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.518785] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.022148] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1308.022148] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1308.493131] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.493280] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1308.589252] env[65446]: INFO networking_nsxv3.common.synchronization [req-4943a9e0-d685-4d1a-b5b7-b04fcf0bc3e7 req-695a70a6-f1ed-4e8c-a92d-abeb0db2902e tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1308.589949] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGHEST for action security_group_members [ 1308.590784] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.590929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.591031] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.591238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.591396] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.591617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.591617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.591791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.591880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.591999] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.868715] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.868904] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.868965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.869210] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.881133] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1308.883706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.884676] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1308.895801] env[65446]: INFO networking_nsxv3.common.synchronization [req-86f323e7-3b4a-4d61-81cf-2e2bcb49b20e req-3646bd4c-9325-4465-bb29-09c63e83ce5d tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1308.896320] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1308.896627] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.896749] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.896815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.897013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.897170] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.897265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.897326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.897468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.897549] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.897639] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.925729] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.925970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.925970] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.927123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.940839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.941739] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1308.941863] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1308.941923] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1308.978377] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.978579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.978628] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.978796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.979926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.980124] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1309.084015] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.084417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.084417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.084417] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.084730] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.085021] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1309.094558] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.094684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.094744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.094932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.141020] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.141415] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.141574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.141658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.141852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.141930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.142039] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be updated. [ 1309.174866] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.175046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.175109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.175282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.175435] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.186073] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: IN_PROGRESS for 2s [ 1309.189130] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.189334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.189410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.189640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.189929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.190218] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 1309.190311] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24', '3905b26b-bddd-4c0d-8d21-44f2dd75c139', 'b114036a-38e3-4f81-b1f6-91a83ad71c82', 'c3e9ab12-2cc1-4bd6-971a-349ffed008be', 'b204e3ce-656a-4d7b-b6f4-7be71e79fd20', 'e6972103-6289-4c91-918e-1586283726a6', '0fadd4d4-be2c-4f94-a4ed-f9222a9605dc', 'a035b80c-7bce-4315-917c-4962056ba63f', 'e5b8bdb1-50db-4ff1-a172-37099eae0157', '38fd7db5-286a-40dc-8ccd-267d22d38c03', 'df9add5c-c992-43ca-9245-5304b7194290', '2e4d3273-8d8e-4ffd-a815-d26dfe2f4235', '402cce96-6e31-494c-bb81-68025c181757', '7dd34d6e-ba50-47dc-9428-10a867ec77b5', '743ab854-8016-4dd1-b444-e671e7099027', 'a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44', '71307925-e0d7-49c9-8bc8-5c5e870d7bca', '2e2374b8-374d-4226-b090-9ede1d4ec196', 'b0365110-9ded-49bd-a10e-2a106e2db350', 'd360f67e-96d2-41e3-87bd-00f87fb4fd70', '98940883-9fda-4b23-9149-fb7213985597', '1358f1df-64ea-4b5e-909f-92bef5099bf1', '8b57e5c1-c933-4317-815e-0311cc4e843e', '4bcaa519-eaf6-4bf5-a9ec-8f1e80048184', '1e2bc70b-412d-4280-9fad-bebbfedfd5fe', 'ea407653-fe6d-49fc-ae9f-5964f5403512', '56ef744e-edae-484b-8821-4f332fd192db', 'e23716b6-1df0-449b-b54b-5cbfb06165bd', '3e72bae3-70cb-43fb-a5f0-90cde0349d10', '992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c', '7232f86f-8f31-43de-aad8-e42a48d1755e', 'ef2378e4-6034-4c52-b983-3b0244de565d', 'c643e66c-7f7f-4e0f-8505-d639c9542f3e', '79c30290-ba80-4936-8673-39beeb72a136', '4c822184-f94c-47e7-a37a-4a1a1df93e39', '73f89999-ebe2-4491-b7a9-a88502cfe139', 'a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8'} {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1309.190400] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1309.193551] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.193551] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.193668] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.194673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.194673] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.194673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.194673] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.194981] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.194981] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.195066] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1309.195172] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1309.195275] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1309.195377] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1309.195479] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1309.195578] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1309.196492] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1309.208749] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.208887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.208960] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.209167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.209264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.209357] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1309.209438] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1309.209516] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1309.212988] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1309.213177] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1309.213315] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1309.213475] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-292" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.213815] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-6c88fa1e-bd38-4ded-b175-b60dc48c3267 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.213988] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.214579] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.214579] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.214579] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c88fa1e-bd38-4ded-b175-b60dc48c3267',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.311085] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.311314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.311411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.311754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.313625] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.314073] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1309.314187] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1309.314305] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1309.314428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1309.314549] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 1309.314759] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGH for action security_group_rules [ 1309.314886] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGH for action security_group_rules [ 1309.315012] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGH for action security_group_rules [ 1309.315166] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGH for action security_group_rules [ 1309.315266] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGH for action security_group_rules [ 1309.315362] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGH for action security_group_rules [ 1309.315457] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGH for action security_group_rules [ 1309.315548] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGH for action security_group_rules [ 1309.315649] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGH for action security_group_rules [ 1309.315762] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGH for action security_group_rules [ 1309.315861] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGH for action security_group_rules [ 1309.315957] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGH for action security_group_rules [ 1309.316066] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGH for action security_group_rules [ 1309.316162] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGH for action security_group_rules [ 1309.316255] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGH for action security_group_rules [ 1309.316362] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGH for action security_group_rules [ 1309.316483] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGH for action security_group_rules [ 1309.316588] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGH for action security_group_rules [ 1309.316676] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGH for action security_group_rules [ 1309.316771] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGH for action security_group_rules [ 1309.316905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.399699] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.716574] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.716857] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.717076] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.717448] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.717646] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.717851] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 6c88fa1e-bd38-4ded-b175-b60dc48c3267 not found, creating... [ 1309.718174] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.718556] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.718556] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.718799] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.718940] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.719312] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.719619] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.719828] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.720145] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.720302] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.720491] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 6c88fa1e-bd38-4ded-b175-b60dc48c3267 is going to be created. [ 1309.741794] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.742019] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.742149] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.742421] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.742681] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.742856] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.902350] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.404294] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.404605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.404605] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.404840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.404937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.405051] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be updated. [ 1310.433665] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.433818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.433869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.434073] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.434215] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.442969] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: IN_PROGRESS for 2s [ 1310.451951] env[65446]: INFO networking_nsxv3.common.synchronization [req-86f323e7-3b4a-4d61-81cf-2e2bcb49b20e req-251b96ac-d48f-40b9-9e40-9943aa249a73 service nova] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 1310.452221] env[65446]: INFO networking_nsxv3.common.synchronization [req-86f323e7-3b4a-4d61-81cf-2e2bcb49b20e req-251b96ac-d48f-40b9-9e40-9943aa249a73 service nova] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1310.452433] env[65446]: INFO networking_nsxv3.common.synchronization [req-86f323e7-3b4a-4d61-81cf-2e2bcb49b20e req-251b96ac-d48f-40b9-9e40-9943aa249a73 service nova] Enqueued Resource ID: 6c88fa1e-bd38-4ded-b175-b60dc48c3267 with Priority: HIGHEST for action port [ 1310.453237] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_rules [ 1310.453458] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1310.453623] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c88fa1e-bd38-4ded-b175-b60dc48c3267 with Priority: HIGHEST for action port [ 1310.453781] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 with Priority: HIGH for action security_group_rules [ 1310.453951] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 with Priority: HIGH for action security_group_rules [ 1310.454119] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc with Priority: HIGH for action security_group_rules [ 1310.454271] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743ab854-8016-4dd1-b444-e671e7099027 with Priority: HIGH for action security_group_rules [ 1310.454587] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 with Priority: HIGH for action security_group_rules [ 1310.454587] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0365110-9ded-49bd-a10e-2a106e2db350 with Priority: HIGH for action security_group_rules [ 1310.454740] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 with Priority: HIGH for action security_group_rules [ 1310.454828] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca with Priority: HIGH for action security_group_rules [ 1310.454974] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 with Priority: HIGH for action security_group_rules [ 1310.455138] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGH for action security_group_rules [ 1310.455280] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGH for action security_group_rules [ 1310.455418] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 with Priority: HIGH for action security_group_rules [ 1310.455560] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9add5c-c992-43ca-9245-5304b7194290 with Priority: HIGH for action security_group_rules [ 1310.455765] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 with Priority: HIGH for action security_group_rules [ 1310.455850] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 with Priority: HIGH for action security_group_rules [ 1310.455991] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6972103-6289-4c91-918e-1586283726a6 with Priority: HIGH for action security_group_rules [ 1310.456147] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a035b80c-7bce-4315-917c-4962056ba63f with Priority: HIGH for action security_group_rules [ 1310.456292] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 with Priority: HIGH for action security_group_rules [ 1310.456427] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 with Priority: HIGH for action security_group_rules [ 1310.456561] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGH for action security_group_rules [ 1310.457411] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.457699] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.457824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.458116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.458237] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.460327] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.460488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.460788] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c88fa1e-bd38-4ded-b175-b60dc48c3267 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.460945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.461058] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.461392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.461512] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c88fa1e-bd38-4ded-b175-b60dc48c3267',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.462945] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.463118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.463348] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.463586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.463700] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.465153] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b114036a-38e3-4f81-b1f6-91a83ad71c82 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.465312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.465410] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.465632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.465745] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b114036a-38e3-4f81-b1f6-91a83ad71c82',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.467050] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.467212] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.467309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.467532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.467648] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fadd4d4-be2c-4f94-a4ed-f9222a9605dc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.469632] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743ab854-8016-4dd1-b444-e671e7099027 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.469816] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.470015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.470374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.470596] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743ab854-8016-4dd1-b444-e671e7099027',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.471920] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.472087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.472188] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.472514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.472646] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d360f67e-96d2-41e3-87bd-00f87fb4fd70',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.474216] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0365110-9ded-49bd-a10e-2a106e2db350 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.474404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.474509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.474729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.474842] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0365110-9ded-49bd-a10e-2a106e2db350',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.475735] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e2374b8-374d-4226-b090-9ede1d4ec196 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.475890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.475988] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.476213] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.476321] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e2374b8-374d-4226-b090-9ede1d4ec196',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.479207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.479207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.479207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.479207] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.479207] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71307925-e0d7-49c9-8bc8-5c5e870d7bca',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.480633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.480791] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.480889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.481193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.481254] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd34d6e-ba50-47dc-9428-10a867ec77b5',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.482552] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.482671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.482957] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.483156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.483241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.483461] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.483571] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.484573] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.484955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.485120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.485305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.485415] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e4d3273-8d8e-4ffd-a815-d26dfe2f4235',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.486167] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9add5c-c992-43ca-9245-5304b7194290 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.486272] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.486323] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.486507] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.486583] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9add5c-c992-43ca-9245-5304b7194290',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.489402] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38fd7db5-286a-40dc-8ccd-267d22d38c03 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.489512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.489580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.489734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.489809] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38fd7db5-286a-40dc-8ccd-267d22d38c03',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.490951] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b8bdb1-50db-4ff1-a172-37099eae0157 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.491079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.491147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.491303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.491375] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b8bdb1-50db-4ff1-a172-37099eae0157',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.492819] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6972103-6289-4c91-918e-1586283726a6 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.492921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.492992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.493156] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.493229] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6972103-6289-4c91-918e-1586283726a6',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.494498] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a035b80c-7bce-4315-917c-4962056ba63f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.494689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.495256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.496412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.496570] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a035b80c-7bce-4315-917c-4962056ba63f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.497273] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.497383] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.497719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.497719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.497719] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b204e3ce-656a-4d7b-b6f4-7be71e79fd20',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.498414] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.498522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.498586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.498751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.498821] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3905b26b-bddd-4c0d-8d21-44f2dd75c139',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.499706] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.499819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.499883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.500048] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.500125] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.528504] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.528701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.528777] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.528955] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.531535] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.531668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.549071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.549214] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd34d6e-ba50-47dc-9428-10a867ec77b5 is going to be deleted. [ 1310.550115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.550325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.567497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.567618] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0365110-9ded-49bd-a10e-2a106e2db350 is going to be deleted. [ 1310.633544] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.633779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.633779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.634096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.634204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.634300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd34d6e-ba50-47dc-9428-10a867ec77b5" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.635045] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.635161] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.635223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.635394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.635477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.635589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0365110-9ded-49bd-a10e-2a106e2db350" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.961321] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.961559] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.964035] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c88fa1e-bd38-4ded-b175-b60dc48c3267 with status ACTIVE [ 1310.964246] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.964368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.964457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.964646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.964739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.964966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.965082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.965147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.965347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.965457] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.965695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.965805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.965869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.966024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.966103] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.966211] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c88fa1e-bd38-4ded-b175-b60dc48c3267 is going to be updated. [ 1310.990944] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.990944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.991250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.991250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.998365] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.998489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.010921] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.011137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.011194] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.011407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.011606] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.011785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.011785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.011872] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.011958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.012291] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.012291] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.017470] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.017630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.018443] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.018573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.019266] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.019433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.020063] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.020182] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.020248] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.020437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.020583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.020744] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c88fa1e-bd38-4ded-b175-b60dc48c3267" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.022125] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.022221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.025207] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.025396] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.027902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.028131] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24 is going to be deleted. [ 1311.029087] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.030120] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.030331] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.036136] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.036293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.044331] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.044476] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.070841] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.071051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.071995] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.072159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.072983] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.073090] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.073786] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.073909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.074510] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.074603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.075280] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.075633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.075753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.076345] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.076834] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.076933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.078412] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.078832] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.078946] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b114036a-38e3-4f81-b1f6-91a83ad71c82 is going to be deleted. [ 1311.079880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.080098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.101287] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.101418] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fadd4d4-be2c-4f94-a4ed-f9222a9605dc is going to be deleted. [ 1311.102393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.102686] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.123896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.124065] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e2374b8-374d-4226-b090-9ede1d4ec196 is going to be deleted. [ 1311.125705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.125705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.142725] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.142856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.144803] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.144934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.155884] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.156039] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d360f67e-96d2-41e3-87bd-00f87fb4fd70 is going to be deleted. [ 1311.157136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.157349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.190402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.190516] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743ab854-8016-4dd1-b444-e671e7099027 is going to be deleted. [ 1311.191430] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.191910] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.198483] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7232f86f-8f31-43de-aad8-e42a48d1755e in Status: SUCCESS [ 1311.198483] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e deletion is rescheduled due to dependency. [ 1311.198483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.226353] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.226353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.247845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.248237] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b8bdb1-50db-4ff1-a172-37099eae0157 is going to be deleted. [ 1311.248907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.249130] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.271016] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.271268] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.332132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.332132] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6972103-6289-4c91-918e-1586283726a6 is going to be deleted. [ 1311.332132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.332132] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.346309] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.346485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.347286] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.347432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.411149] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.411473] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71307925-e0d7-49c9-8bc8-5c5e870d7bca is going to be deleted. [ 1311.412367] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.412616] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.414281] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.414281] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.475835] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.476069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.476433] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.476549] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be deleted. [ 1311.477473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.477716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.508555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.508732] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38fd7db5-286a-40dc-8ccd-267d22d38c03 is going to be deleted. [ 1311.509697] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.509941] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.535809] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 402cce96-6e31-494c-bb81-68025c181757: rpc.has_security_group_logging(os_id): False [ 1311.557103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.557293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.575639] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.575847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.576772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.576925] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9add5c-c992-43ca-9245-5304b7194290 is going to be deleted. [ 1311.577815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.578229] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.669769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.670012] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e4d3273-8d8e-4ffd-a815-d26dfe2f4235 is going to be deleted. [ 1311.671640] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.671883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.689891] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.690137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.726353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.726514] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3905b26b-bddd-4c0d-8d21-44f2dd75c139 is going to be deleted. [ 1311.727467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.728660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.729666] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.729666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.746160] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.746332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.801800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.801800] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b204e3ce-656a-4d7b-b6f4-7be71e79fd20 is going to be deleted. [ 1311.801800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.802483] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.807490] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.807490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.855174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.855174] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a035b80c-7bce-4315-917c-4962056ba63f is going to be deleted. [ 1311.855622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.855831] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.855921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.856059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4ab9ba-1d59-4bd8-a6b5-749beaa60f24" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.856219] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.856374] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.856452] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.856569] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b114036a-38e3-4f81-b1f6-91a83ad71c82" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.857095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.857391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.857391] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.857501] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fadd4d4-be2c-4f94-a4ed-f9222a9605dc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.857603] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.857767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.857834] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.857943] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e2374b8-374d-4226-b090-9ede1d4ec196" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.858123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.858267] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.858345] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.858492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743ab854-8016-4dd1-b444-e671e7099027" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.858587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.858708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.858784] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.858890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d360f67e-96d2-41e3-87bd-00f87fb4fd70" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.859024] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.859160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.859236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.859390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b8bdb1-50db-4ff1-a172-37099eae0157" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.859489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.859743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.859743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.859840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6972103-6289-4c91-918e-1586283726a6" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.859945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.860111] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.860200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.860306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71307925-e0d7-49c9-8bc8-5c5e870d7bca" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.860462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.860602] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.929891] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.930122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.933567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.933871] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.933984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.934036] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.934252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.934341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.934436] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402cce96-6e31-494c-bb81-68025c181757 is going to be updated. [ 1311.935543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.935719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.935805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.935924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.936070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.936220] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.936295] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.936424] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38fd7db5-286a-40dc-8ccd-267d22d38c03" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.936574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.936717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.936794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.936909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9add5c-c992-43ca-9245-5304b7194290" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.937037] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.937179] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.937258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.937368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e4d3273-8d8e-4ffd-a815-d26dfe2f4235" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.937918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.938142] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.938226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.938346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3905b26b-bddd-4c0d-8d21-44f2dd75c139" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.949536] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.949736] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.949800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.950029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.950124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.950252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b204e3ce-656a-4d7b-b6f4-7be71e79fd20" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.985800] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.986013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.986013] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.986236] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.986326] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.986445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a035b80c-7bce-4315-917c-4962056ba63f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.204967] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1312.205570] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.205743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.205789] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.205995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.206162] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.255394] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: IN_PROGRESS for 2s [ 1312.453962] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 1312.454370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.454411] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.454635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.454830] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.454968] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.455043] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.455216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.455292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.455393] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.958779] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.089161] env[65446]: INFO networking_nsxv3.common.synchronization [None req-9e0097e0-39fb-4812-829d-39667e3a294b tempest-AttachInterfacesTestJSON-1975589407 tempest-AttachInterfacesTestJSON-1975589407-project-member] Enqueued Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1313.089161] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be with Priority: HIGHEST for action security_group_members [ 1313.089366] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3e9ab12-2cc1-4bd6-971a-349ffed008be taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.089490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.089490] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.089925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.089925] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.089925] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.090646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.090646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.090646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.090646] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3e9ab12-2cc1-4bd6-971a-349ffed008be',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.598953] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.602079] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.602079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.602079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.602079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.602079] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.602079] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.602547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.602547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.602547] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.602782] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.602941] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3e9ab12-2cc1-4bd6-971a-349ffed008be is going to be deleted. [ 1313.641789] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.642012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.642012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.642238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.642370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.642438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3e9ab12-2cc1-4bd6-971a-349ffed008be" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.105186] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.105448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.105753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.106025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.106124] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.106229] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be updated. [ 1314.136541] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.136727] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.136808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.136974] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.137136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.147208] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: IN_PROGRESS for 2s [ 1314.287884] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: SUCCESS [ 1314.288138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.444869] env[65446]: INFO networking_nsxv3.common.synchronization [req-a05ed25d-509b-4dbd-b4d5-0771c4317c0c req-aa634b09-fd85-48d0-8f93-e8b7221f8e52 tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1315.445452] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1315.445768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.445890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.445961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.446168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.446311] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.446415] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.446479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.446592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.446668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.446760] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.949383] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.949558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.949558] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.949844] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.973966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.974260] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.974413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.974478] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.974659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.974741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.974835] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1316.010139] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.010370] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.010416] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.010683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.010776] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.021876] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1316.157277] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 1316.157510] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.157682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.157895] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.158103] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.158235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.158299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.158451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.158530] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.158619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.158715] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.661025] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.166275] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44: rpc.has_security_group_logging(os_id): False [ 1317.185612] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.185612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.185612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.185612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.208195] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.208743] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.208936] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.209225] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.209486] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.209654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.209862] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be updated. [ 1317.277885] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.278096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.278140] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.278465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.278623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.294374] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: IN_PROGRESS for 2s [ 1317.384555] env[65446]: INFO networking_nsxv3.common.synchronization [None req-990f1176-7db4-48f2-a2fd-b84b355bd52b None None] Enqueued Resource ID: 4c38ad57-aa8a-4486-9a9d-2b5c539286f8 with Priority: HIGHEST for action port [ 1317.384783] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c38ad57-aa8a-4486-9a9d-2b5c539286f8 with Priority: HIGHEST for action port [ 1317.385112] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c38ad57-aa8a-4486-9a9d-2b5c539286f8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.385238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c38ad57-aa8a-4486-9a9d-2b5c539286f8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.385305] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c38ad57-aa8a-4486-9a9d-2b5c539286f8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.385626] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c38ad57-aa8a-4486-9a9d-2b5c539286f8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.385713] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c38ad57-aa8a-4486-9a9d-2b5c539286f8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.889153] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c38ad57-aa8a-4486-9a9d-2b5c539286f8 [ 1317.890688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.891468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.891909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.892022] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.892209] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.892361] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c38ad57-aa8a-4486-9a9d-2b5c539286f8 already deleted. [ 1317.895484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c38ad57-aa8a-4486-9a9d-2b5c539286f8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.032207] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1318.032392] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 deletion is rescheduled due to dependency. [ 1318.032438] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.310217] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 1319.311871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.311871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.311871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.311871] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.731506] env[65446]: INFO networking_nsxv3.common.synchronization [None req-df4e5834-a775-46e2-9e04-53ef1c5b1d7e None None] Enqueued Resource ID: b80ea5c4-f9c7-4d05-a986-4803f70c00da with Priority: HIGHEST for action port [ 1319.734066] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b80ea5c4-f9c7-4d05-a986-4803f70c00da with Priority: HIGHEST for action port [ 1319.734066] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b80ea5c4-f9c7-4d05-a986-4803f70c00da taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.734066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b80ea5c4-f9c7-4d05-a986-4803f70c00da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.734066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b80ea5c4-f9c7-4d05-a986-4803f70c00da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.734066] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b80ea5c4-f9c7-4d05-a986-4803f70c00da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.734066] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b80ea5c4-f9c7-4d05-a986-4803f70c00da',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.815027] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.815238] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.815319] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.815595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.815720] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.815826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.815889] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.816069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.816174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.816246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.816337] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.900830] env[65446]: INFO networking_nsxv3.common.synchronization [None req-31453a3a-cc5a-4862-91ec-d3aad6a1855d None None] Enqueued Resource ID: 69e876ed-df53-4de6-989d-41ce87d54033 with Priority: HIGHEST for action port [ 1319.901682] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e876ed-df53-4de6-989d-41ce87d54033 with Priority: HIGHEST for action port [ 1319.901682] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-69e876ed-df53-4de6-989d-41ce87d54033 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.901921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69e876ed-df53-4de6-989d-41ce87d54033" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.901921] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69e876ed-df53-4de6-989d-41ce87d54033" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.902769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69e876ed-df53-4de6-989d-41ce87d54033" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.902769] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69e876ed-df53-4de6-989d-41ce87d54033',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.239424] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b80ea5c4-f9c7-4d05-a986-4803f70c00da [ 1320.239626] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.239836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.239939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.240114] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.240275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.240387] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b80ea5c4-f9c7-4d05-a986-4803f70c00da already deleted. [ 1320.240387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b80ea5c4-f9c7-4d05-a986-4803f70c00da" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.319854] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.404077] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69e876ed-df53-4de6-989d-41ce87d54033 [ 1320.404343] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.404485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.404552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.404966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.404966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.404966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69e876ed-df53-4de6-989d-41ce87d54033 already deleted. [ 1320.405133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69e876ed-df53-4de6-989d-41ce87d54033" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.823888] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44: rpc.has_security_group_logging(os_id): False [ 1320.841734] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.841911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.841981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.842204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.842297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.842543] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.842652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.842731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.842965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.842965] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.843135] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be updated. [ 1320.904996] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.904996] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.905159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.905362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.905414] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.919885] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: IN_PROGRESS for 2s [ 1322.383475] env[65446]: INFO networking_nsxv3.common.synchronization [None req-8d61b16f-acc8-489f-bdd7-df1864aac524 None None] Enqueued Resource ID: feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b with Priority: HIGHEST for action port [ 1322.384091] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b with Priority: HIGHEST for action port [ 1322.384442] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.384517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.384615] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.384958] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.385073] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.887861] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b [ 1322.888121] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.888255] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.888526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.888526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.888632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.888703] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b already deleted. [ 1322.888863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feab4ce1-7d6b-4bb8-a04b-fb719b2ca77b" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.934958] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 1322.935332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.438400] env[65446]: INFO networking_nsxv3.common.synchronization [req-9e2b0455-f097-4da1-b17c-cf6b186b59fd req-49e249de-1962-45ff-809a-6c309985b42e tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1325.439162] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1325.439162] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.439274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.439274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.439445] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.439607] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.439737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.439805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.441539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.441635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.441757] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.759593] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.759747] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.759797] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.760092] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.760376] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.760543] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.760666] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.760899] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.761075] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.761308] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1325.761426] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1325.761575] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1325.761660] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1325.761815] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1325.761976] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1325.762102] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1325.786412] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1325.786592] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1325.786756] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1325.786955] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.787336] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.787509] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.787647] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.787998] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.788170] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5eb704b-4d75-4a74-b6d2-fc684a9b55fc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.944146] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.944353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.944429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.944734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.944886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.945188] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.945304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.945369] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.945536] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.945654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.945777] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1325.972821] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.973039] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.973109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.973322] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.973467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.982369] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1326.291230] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.291502] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.291650] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.292168] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.292365] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.292570] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port b5eb704b-4d75-4a74-b6d2-fc684a9b55fc not found, creating... [ 1326.292919] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.293509] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.293509] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.293598] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.293743] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.294160] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.294439] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.294524] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.294824] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.294983] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.295198] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc is going to be created. [ 1326.320923] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.321144] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.321233] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.321506] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.321879] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.322242] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.021557] env[65446]: INFO networking_nsxv3.common.synchronization [req-9e2b0455-f097-4da1-b17c-cf6b186b59fd req-83a196d8-9dc3-45f4-a629-18289a153b96 service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1327.021557] env[65446]: INFO networking_nsxv3.common.synchronization [req-9e2b0455-f097-4da1-b17c-cf6b186b59fd req-83a196d8-9dc3-45f4-a629-18289a153b96 service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1327.021949] env[65446]: INFO networking_nsxv3.common.synchronization [req-9e2b0455-f097-4da1-b17c-cf6b186b59fd req-83a196d8-9dc3-45f4-a629-18289a153b96 service nova] Enqueued Resource ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc with Priority: HIGHEST for action port [ 1327.022160] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1327.022298] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1327.022449] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc with Priority: HIGHEST for action port [ 1327.022671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.022801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.022866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.023106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.023194] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.024076] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.024688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.024688] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.024688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.024688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.024688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.025024] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5eb704b-4d75-4a74-b6d2-fc684a9b55fc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.527165] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.527364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.527473] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5eb704b-4d75-4a74-b6d2-fc684a9b55fc with status ACTIVE [ 1327.527693] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.527820] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.527907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.528151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.528230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.528403] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.528499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.528562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.528718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.528836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.528978] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.529084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.529166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.529310] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.529386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.529472] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc is going to be updated. [ 1327.555436] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.555673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.555673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.555874] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.556026] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.556200] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.710096] env[65446]: INFO networking_nsxv3.common.synchronization [req-937d0a97-be70-486d-85c2-0e85cbb6e4ec req-6394c75b-7871-4efa-a4ae-03d15052fa91 tempest-ServersNegativeTestMultiTenantJSON-913977193 tempest-ServersNegativeTestMultiTenantJSON-913977193-project-member] Enqueued Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_members [ 1327.710641] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_members [ 1327.710959] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.711098] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.711167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.711413] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.711567] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.711665] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.711766] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.711905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.711992] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.712096] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.993901] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1327.994199] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 deletion is rescheduled due to dependency. [ 1327.994375] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.994611] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.994917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.995198] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.995371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.995477] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.995705] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.995840] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.995991] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.006753] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.006998] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-563" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.007182] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-563" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.007506] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-563" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.007776] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.007940] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.008073] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.008287] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.008433] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.008651] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1328.008767] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1328.008877] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1328.008984] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1328.009103] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1328.009207] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1328.009336] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1328.028179] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1328.028465] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1328.028504] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1328.028726] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-563" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.029068] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.029254] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.029377] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.029725] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.029868] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23995298-3c1d-4eba-b0cb-e22d9c7e0f48',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.213924] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.214137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.214269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.214498] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.214589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.214803] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.214928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.215000] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.215153] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.215233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.215319] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f already deleted. [ 1328.215401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.499068] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.532778] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.533009] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.533154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.533550] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.533620] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.533729] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port 23995298-3c1d-4eba-b0cb-e22d9c7e0f48 not found, creating... [ 1328.533983] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.534160] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.534279] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.534492] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.534630] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.534953] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.535134] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.535254] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.535457] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.535591] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.535730] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: 23995298-3c1d-4eba-b0cb-e22d9c7e0f48 is going to be created. [ 1328.555960] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.556204] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.556386] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.556716] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.556961] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.557345] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.002033] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.273604] env[65446]: INFO networking_nsxv3.common.synchronization [req-937d0a97-be70-486d-85c2-0e85cbb6e4ec req-d7caa00a-2bc3-47d6-89d8-d5966dac2850 service nova] Enqueued Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_rules [ 1329.273863] env[65446]: INFO networking_nsxv3.common.synchronization [req-937d0a97-be70-486d-85c2-0e85cbb6e4ec req-d7caa00a-2bc3-47d6-89d8-d5966dac2850 service nova] Enqueued Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_members [ 1329.273903] env[65446]: INFO networking_nsxv3.common.synchronization [req-937d0a97-be70-486d-85c2-0e85cbb6e4ec req-d7caa00a-2bc3-47d6-89d8-d5966dac2850 service nova] Enqueued Resource ID: 23995298-3c1d-4eba-b0cb-e22d9c7e0f48 with Priority: HIGHEST for action port [ 1329.274413] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_rules [ 1329.274554] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_members [ 1329.274652] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23995298-3c1d-4eba-b0cb-e22d9c7e0f48 with Priority: HIGHEST for action port [ 1329.274935] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.275070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.275138] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.275517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.275517] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.276664] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.276781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.276835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.277019] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.277651] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.277651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.277651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.277651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.277651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.277651] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.278376] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.278485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.278566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.278682] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.278760] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23995298-3c1d-4eba-b0cb-e22d9c7e0f48',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.503835] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.503997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.504081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.504294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.504381] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.504476] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1329.537658] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.537853] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.537927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.538178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.538353] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.546732] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1329.780528] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.781811] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.781924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.782231] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23995298-3c1d-4eba-b0cb-e22d9c7e0f48 with status ACTIVE [ 1329.782338] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.782453] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.782522] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.782774] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.782835] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.783254] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.783254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.783254] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.783423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.783423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.783598] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.783696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.783783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.783939] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.783981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.784077] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23995298-3c1d-4eba-b0cb-e22d9c7e0f48 is going to be updated. [ 1329.813671] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.813863] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.813929] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.814178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.814346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.814520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23995298-3c1d-4eba-b0cb-e22d9c7e0f48" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.286277] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.788719] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.788907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.788907] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.789137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.789241] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.789320] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f is going to be created. [ 1330.817908] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.818150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.818150] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.818355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.818525] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.827669] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f in Status: UNINITIALIZED for 2s [ 1331.084862] env[65446]: INFO networking_nsxv3.common.synchronization [req-16dc1123-2226-43f9-a94a-da82ff00a910 req-68d89bdf-9427-4644-8980-9ae4abf6259c tempest-AttachVolumeShelveTestJSON-112443722 tempest-AttachVolumeShelveTestJSON-112443722-project-member] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1331.085533] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGHEST for action security_group_members [ 1331.085853] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.085977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.086192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.086406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.086569] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.086671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.086734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.086923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.087052] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.087052] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.560508] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1331.560508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.560508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.560508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.560508] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.560508] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.560948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.560948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.560948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.560948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.561098] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.589826] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.590029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.590095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.590277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.590365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.590561] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.590660] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.590722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.590869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.590945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.591046] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402cce96-6e31-494c-bb81-68025c181757 is going to be updated. [ 1331.642422] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.642666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.642666] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.642933] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.643186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.659599] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: IN_PROGRESS for 2s [ 1332.064189] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.567049] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1358f1df-64ea-4b5e-909f-92bef5099bf1: rpc.has_security_group_logging(os_id): False [ 1332.585523] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.585718] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.585765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.586030] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.586147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.586428] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.586545] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.586624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.586810] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.586896] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.587014] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1332.665432] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.665622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.665622] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.665856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.665978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.692847] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1332.839419] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f in Status: SUCCESS [ 1332.839639] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.839837] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.840151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.840353] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.840475] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.840542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.840700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.840783] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.840869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.840960] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.343441] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.343613] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.343691] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.343891] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.344160] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.344160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.344394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.344394] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.344506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.344506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.344657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.344737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.344790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.344930] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.345143] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.345257] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.345318] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.345565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.345565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.345667] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.345713] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.669984] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402cce96-6e31-494c-bb81-68025c181757 in Status: SUCCESS [ 1333.670351] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402cce96-6e31-494c-bb81-68025c181757 deletion is rescheduled due to dependency. [ 1333.670404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.848171] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 545f9fb3-ef14-4e31-a99e-b6b0b153644f: rpc.has_security_group_logging(os_id): False [ 1333.868364] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.868567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.868621] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.868813] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.868902] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.869150] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.869252] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.869327] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.869488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.869566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.869751] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.869849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.869912] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.870072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.870147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.870336] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.870431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.870503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.870641] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.870731] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.870816] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f is going to be created. [ 1333.946309] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.946532] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.946657] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.947122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.947235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.966732] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f in Status: IN_PROGRESS for 2s [ 1334.705418] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1334.705418] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.981767] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f in Status: SUCCESS [ 1335.982123] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.086903] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.087114] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.926778] env[65446]: INFO networking_nsxv3.common.synchronization [req-d4ad3b4a-8f02-467a-9cd8-631c5db2f8a8 req-d7f8df5a-672e-4275-a74d-65d1f9d06cfa tempest-ServersNegativeTestMultiTenantJSON-913977193 tempest-ServersNegativeTestMultiTenantJSON-913977193-project-member] Enqueued Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_members [ 1339.927824] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGHEST for action security_group_members [ 1339.928295] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.929583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.929583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.929583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.929583] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.929583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.929583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.929583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.929583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.930103] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.433205] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.433386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.433442] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.433662] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.433754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.433955] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.434069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.434134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.434340] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.434378] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.434437] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f is going to be updated. [ 1340.467954] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.467954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.467954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.467954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.467954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.477321] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f in Status: IN_PROGRESS for 2s [ 1342.490393] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f in Status: SUCCESS [ 1342.490748] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f deletion is rescheduled due to dependency. [ 1342.490815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.116438] env[65446]: INFO networking_nsxv3.common.synchronization [None req-1043806a-d64c-4d5a-b841-de66d4f6273e None None] Enqueued Resource ID: c208aca3-f41e-4409-96c4-d9fe7a90a6cd with Priority: HIGHEST for action port [ 1344.116778] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c208aca3-f41e-4409-96c4-d9fe7a90a6cd with Priority: HIGHEST for action port [ 1344.117656] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-c208aca3-f41e-4409-96c4-d9fe7a90a6cd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.117785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c208aca3-f41e-4409-96c4-d9fe7a90a6cd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.117855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c208aca3-f41e-4409-96c4-d9fe7a90a6cd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.118178] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c208aca3-f41e-4409-96c4-d9fe7a90a6cd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.118266] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c208aca3-f41e-4409-96c4-d9fe7a90a6cd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.620733] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c208aca3-f41e-4409-96c4-d9fe7a90a6cd [ 1344.620963] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.621214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.621282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.621504] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.621607] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.621677] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c208aca3-f41e-4409-96c4-d9fe7a90a6cd already deleted. [ 1344.621761] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c208aca3-f41e-4409-96c4-d9fe7a90a6cd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.773734] env[65446]: INFO networking_nsxv3.common.synchronization [None req-187d09fb-7ed7-4494-9fe0-91fa44c6c0aa tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_rules [ 1344.773734] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_rules [ 1344.773963] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.774101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.774166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.774419] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.774504] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.867336] env[65446]: INFO networking_nsxv3.common.synchronization [None req-96c56b5b-a0a7-4de5-9b93-45099604f9e9 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_rules [ 1344.867336] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_rules [ 1344.867336] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.867336] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.304072] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.304449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.304449] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.304656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.304765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.304932] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a already deleted. [ 1345.305071] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.305259] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.305446] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.305578] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.848347] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.848592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.848592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.849334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.849334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.849334] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a already deleted. [ 1345.849334] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.409953] env[65446]: INFO networking_nsxv3.common.synchronization [None req-fd0c7835-53ff-426d-8802-299b5bbc5261 None None] Enqueued Resource ID: 92ed200a-704e-431f-a140-fdfbfdd2d126 with Priority: HIGHEST for action port [ 1346.409953] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92ed200a-704e-431f-a140-fdfbfdd2d126 with Priority: HIGHEST for action port [ 1346.410696] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-92ed200a-704e-431f-a140-fdfbfdd2d126 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.410696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92ed200a-704e-431f-a140-fdfbfdd2d126" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.410696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92ed200a-704e-431f-a140-fdfbfdd2d126" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.410822] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92ed200a-704e-431f-a140-fdfbfdd2d126" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.410920] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92ed200a-704e-431f-a140-fdfbfdd2d126',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.913859] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92ed200a-704e-431f-a140-fdfbfdd2d126 [ 1346.914068] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.914198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.914285] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.914509] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.914651] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.914708] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92ed200a-704e-431f-a140-fdfbfdd2d126 already deleted. [ 1346.914762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92ed200a-704e-431f-a140-fdfbfdd2d126" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.387406] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fcac6f9-8e72-4ca3-9aff-1b2212aa9a2c req-c2758707-b301-43f7-8b0e-663637bac523 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_members [ 1350.387935] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_members [ 1350.388621] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.388764] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.388836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.389198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.389382] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.389489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.389552] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.389719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.389805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.389900] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.650357] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.650603] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.650788] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.651159] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.651542] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.651638] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.651757] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.652064] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.652233] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.652447] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.652581] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1350.652750] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1350.652864] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1350.653013] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.653129] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1350.653262] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1350.673631] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1350.673813] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1350.673953] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1350.674162] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.674480] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-f0f6c287-b04a-4f03-934d-1674a9209e14 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.674656] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.674778] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.675122] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.675267] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0f6c287-b04a-4f03-934d-1674a9209e14',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.892083] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.892293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.892293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.892489] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.892578] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.892785] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.892886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.892952] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.893121] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.893211] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.893546] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a already deleted. [ 1350.893546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.177959] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.178304] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.178441] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.178720] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.178885] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.179056] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port f0f6c287-b04a-4f03-934d-1674a9209e14 not found, creating... [ 1351.179322] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.179483] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.179601] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.179819] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.179983] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.180295] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.180455] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.180571] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.180779] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.180915] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.181079] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: f0f6c287-b04a-4f03-934d-1674a9209e14 is going to be created. [ 1351.202122] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.202439] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.202495] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.202754] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.202990] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.203295] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.909046] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fcac6f9-8e72-4ca3-9aff-1b2212aa9a2c req-249e7489-8c0d-4a17-bfcb-fcf3cd864486 service nova] Enqueued Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_rules [ 1351.909334] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fcac6f9-8e72-4ca3-9aff-1b2212aa9a2c req-249e7489-8c0d-4a17-bfcb-fcf3cd864486 service nova] Enqueued Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_members [ 1351.909334] env[65446]: INFO networking_nsxv3.common.synchronization [req-9fcac6f9-8e72-4ca3-9aff-1b2212aa9a2c req-249e7489-8c0d-4a17-bfcb-fcf3cd864486 service nova] Enqueued Resource ID: f0f6c287-b04a-4f03-934d-1674a9209e14 with Priority: HIGHEST for action port [ 1351.909867] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_rules [ 1351.910101] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_members [ 1351.910213] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f6c287-b04a-4f03-934d-1674a9209e14 with Priority: HIGHEST for action port [ 1351.910549] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.910604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.910675] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.910906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.910951] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.911811] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.911934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.912059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.912269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.912381] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.912567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.912567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.912717] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.912799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.912890] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.913703] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0f6c287-b04a-4f03-934d-1674a9209e14 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.914082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.914160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.914332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.914412] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0f6c287-b04a-4f03-934d-1674a9209e14',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.416202] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.417293] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.417426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.417561] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0f6c287-b04a-4f03-934d-1674a9209e14 with status ACTIVE [ 1352.417719] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.417826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.417893] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.418133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.418265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.418453] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.418553] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.418619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.418771] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.418851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.419663] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.420587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.420587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.420587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.420587] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.420587] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0f6c287-b04a-4f03-934d-1674a9209e14 is going to be updated. [ 1352.440557] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.440756] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.440836] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.441049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.441189] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.441349] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0f6c287-b04a-4f03-934d-1674a9209e14" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.922651] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.425487] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.425839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.425839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.425916] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.426014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.426103] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a is going to be created. [ 1353.454920] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.455114] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.455183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.455365] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.455543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.468295] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a in Status: UNINITIALIZED for 2s [ 1355.479269] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a in Status: SUCCESS [ 1355.479677] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.479976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.479976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.480113] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.480228] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.480293] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.480437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.480514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.480597] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.480685] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.982924] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.485209] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cb0c2db-4ab0-4029-81e5-acf688b8013a: rpc.has_security_group_logging(os_id): False [ 1356.503899] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.504072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.504122] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.504377] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.504473] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.504713] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.504817] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.504880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.505049] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.505392] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.505392] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a is going to be created. [ 1356.567366] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.567591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.567591] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.567780] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.567957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.578996] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a in Status: IN_PROGRESS for 2s [ 1356.911805] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.912059] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1358.592043] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a in Status: SUCCESS [ 1358.592464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.913370] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.913749] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.915238] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.915628] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.916066] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.916066] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.701516] env[65446]: INFO networking_nsxv3.common.synchronization [req-b15461f8-3ee1-4116-b2da-2bcc6a590989 req-41a2625f-69ed-4bcb-9dfe-38764ea296c2 tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1376.701853] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1376.702177] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.702332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.702412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.702617] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.702988] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.703118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.703183] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.703368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.703464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.703568] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.205693] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.708062] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.213127] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.213346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.213426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.213729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.213862] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.213966] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be updated. [ 1378.242664] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.242814] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.242887] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.243118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.243264] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.254571] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: IN_PROGRESS for 2s [ 1380.264792] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 1380.265197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.703214] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.703688] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.704243] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.704644] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.705250] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.705651] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.126955] env[65446]: INFO networking_nsxv3.common.synchronization [req-bff73047-1563-4a57-8e6d-30599ebbf796 req-2ce98a0e-5b73-48d1-b088-ef682c1243f4 tempest-ServerActionsTestOtherA-229232771 tempest-ServerActionsTestOtherA-229232771-project-member] Enqueued Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1392.127309] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 with Priority: HIGHEST for action security_group_members [ 1392.127616] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.127739] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.127818] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.128056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.128215] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.128317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.128382] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.128519] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.128606] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.128697] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.630779] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.631585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.631585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.631585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.631585] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.631799] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.631869] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.631906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.632061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.632115] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.632201] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 is going to be updated. [ 1392.664474] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.664474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.664474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.664743] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.664792] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.673657] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: IN_PROGRESS for 2s [ 1394.683912] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 in Status: SUCCESS [ 1394.684297] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44 deletion is rescheduled due to dependency. [ 1394.684297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.128590] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.128884] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.111276] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.111611] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.111611] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.111893] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.112161] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.112318] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.112469] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.112684] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.112843] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.113139] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1399.113281] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1399.113395] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1399.113530] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1399.113647] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1399.113756] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1399.113891] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1399.133616] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1399.133765] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1399.133904] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1399.134093] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-665" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.134392] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.134562] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.134683] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.134923] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.135075] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5eb704b-4d75-4a74-b6d2-fc684a9b55fc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.637674] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.637901] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.638043] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.638336] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.638493] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.638774] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.638933] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.639061] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.639280] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.639419] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.639706] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.639869] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.639987] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.640218] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.640357] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.640517] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc is going to be updated. [ 1399.672970] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.673342] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.673523] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.673875] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.674113] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.674353] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.372643] env[65446]: INFO networking_nsxv3.common.synchronization [req-d025dd36-8f25-4287-ab16-f0d101e27dcd req-0d797216-1733-4f11-8231-156b764b4b26 service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1400.372965] env[65446]: INFO networking_nsxv3.common.synchronization [req-d025dd36-8f25-4287-ab16-f0d101e27dcd req-0d797216-1733-4f11-8231-156b764b4b26 service nova] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1400.373074] env[65446]: INFO networking_nsxv3.common.synchronization [req-d025dd36-8f25-4287-ab16-f0d101e27dcd req-0d797216-1733-4f11-8231-156b764b4b26 service nova] Enqueued Resource ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc with Priority: HIGHEST for action port [ 1400.373691] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_rules [ 1400.373837] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1400.373963] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc with Priority: HIGHEST for action port [ 1400.374232] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.374362] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.374429] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.374635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.374722] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.375649] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.375753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.375801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.375976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.376136] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.376231] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.376300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.376431] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.376516] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.376609] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.377407] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.377515] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.377637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.377742] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.377819] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5eb704b-4d75-4a74-b6d2-fc684a9b55fc',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.879783] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.879991] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.880057] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5eb704b-4d75-4a74-b6d2-fc684a9b55fc with status ACTIVE [ 1400.880229] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.880338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.880459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.880620] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.880711] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.880883] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.880978] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.881051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.881198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.881274] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.881450] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.881598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.881598] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.881733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.881806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.881891] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5eb704b-4d75-4a74-b6d2-fc684a9b55fc is going to be updated. [ 1400.883054] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.905927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.906164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.906164] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.906335] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.906467] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.906631] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5eb704b-4d75-4a74-b6d2-fc684a9b55fc" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.386373] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.889476] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.889658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.889750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.890096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.890199] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.890309] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1401.923357] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.923573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.923573] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.923809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.923961] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.934809] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1403.946317] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1403.946704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.946704] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.946954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.947202] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.947339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.947409] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.947579] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.947661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.947752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.947852] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.450789] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.953774] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1358f1df-64ea-4b5e-909f-92bef5099bf1: rpc.has_security_group_logging(os_id): False [ 1404.974360] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.974360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.974360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.974360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.974360] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.974715] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.974715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.974715] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.975056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.975056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.975056] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1405.057662] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.057833] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.057892] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.058126] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.058269] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.071547] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1405.375021] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.375275] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1406.545392] env[65446]: INFO networking_nsxv3.common.synchronization [None req-e7fd217a-b1bc-453c-aa04-f66be58e3a7b tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_rules [ 1406.546048] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_rules [ 1406.546389] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.546543] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.546635] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.546908] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.547031] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.627892] env[65446]: INFO networking_nsxv3.common.synchronization [None req-92a012a1-c9ee-434b-991c-135760c429c4 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_rules [ 1406.628440] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_rules [ 1406.628765] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.628871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.069515] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.069669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.069729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.069954] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.070057] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.070158] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 already deleted. [ 1407.070246] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.070398] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.070581] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.070665] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.088148] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1407.088385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.591966] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.592390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.592390] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.592576] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.592668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.592806] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 already deleted. [ 1407.592901] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.629756] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.630203] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.150184] env[65446]: INFO networking_nsxv3.common.synchronization [req-f56e7ecc-ee50-4b5c-9826-41050cbcd30b req-565163f8-8900-4a8b-be09-e26469436c7e tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_members [ 1412.150776] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_members [ 1412.151174] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.151239] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.151277] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.151521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.151673] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.151785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.151849] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.151990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.152095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.152197] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.655279] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.655728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.655728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.655728] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.655852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.658070] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.658070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.658070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.658070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.658070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.658070] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 already deleted. [ 1412.658070] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.949312] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.949312] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.949312] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.949581] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.950149] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.950494] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.950612] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.950743] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.950903] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.951154] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.951271] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1412.951461] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1412.951613] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1412.951741] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.951848] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1412.951989] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1412.988586] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1412.988792] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1412.988900] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1412.989141] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.989562] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.989779] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.989910] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.990372] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.990576] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883860ca-e3e9-49c8-8b0d-e5bc41931dc7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.493052] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.493304] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.493436] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.493777] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.493944] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.494117] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 883860ca-e3e9-49c8-8b0d-e5bc41931dc7 not found, creating... [ 1413.494383] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.494556] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.494679] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.494914] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.495098] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.495466] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.495682] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.495789] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.496017] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.496166] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.496310] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 883860ca-e3e9-49c8-8b0d-e5bc41931dc7 is going to be created. [ 1413.516080] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.516338] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.516519] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.516854] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.517154] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.517440] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.190794] env[65446]: INFO networking_nsxv3.common.synchronization [req-f56e7ecc-ee50-4b5c-9826-41050cbcd30b req-1bf580a2-37d7-4276-ba03-f8014ff5c6b5 service nova] Enqueued Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_rules [ 1414.190794] env[65446]: INFO networking_nsxv3.common.synchronization [req-f56e7ecc-ee50-4b5c-9826-41050cbcd30b req-1bf580a2-37d7-4276-ba03-f8014ff5c6b5 service nova] Enqueued Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_members [ 1414.190794] env[65446]: INFO networking_nsxv3.common.synchronization [req-f56e7ecc-ee50-4b5c-9826-41050cbcd30b req-1bf580a2-37d7-4276-ba03-f8014ff5c6b5 service nova] Enqueued Resource ID: 883860ca-e3e9-49c8-8b0d-e5bc41931dc7 with Priority: HIGHEST for action port [ 1414.191314] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_rules [ 1414.191456] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_members [ 1414.191626] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 883860ca-e3e9-49c8-8b0d-e5bc41931dc7 with Priority: HIGHEST for action port [ 1414.191831] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.191957] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.192152] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.192379] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.192466] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.193658] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.193658] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.193767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.193888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.194054] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.194151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.194216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.194359] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.194448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.194541] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.198223] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.198618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.198618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.198618] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.198718] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883860ca-e3e9-49c8-8b0d-e5bc41931dc7',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.699902] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.701317] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.701485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.701698] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 883860ca-e3e9-49c8-8b0d-e5bc41931dc7 with status ACTIVE [ 1414.701923] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.702094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.702185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.702468] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.702604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.702843] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.703266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.703566] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.703781] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.703911] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.704315] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.704484] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.704646] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.704866] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.705010] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.705110] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 883860ca-e3e9-49c8-8b0d-e5bc41931dc7 is going to be updated. [ 1414.726633] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.726880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.726880] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.727069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.727159] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.727317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-883860ca-e3e9-49c8-8b0d-e5bc41931dc7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.207758] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.710501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.710706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.710817] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.710995] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.711105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.711204] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 is going to be created. [ 1415.734978] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.735214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.735214] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.735400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.735557] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.744125] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 in Status: UNINITIALIZED for 2s [ 1417.756065] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 in Status: SUCCESS [ 1417.756065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.756065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.756065] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.756520] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.756520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.756520] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.756649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.756649] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.756707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.756869] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.259563] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.762448] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 722b2657-3054-4f94-8e4a-ff7958eed1a2: rpc.has_security_group_logging(os_id): False [ 1418.782263] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.782488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.782488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.782722] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.782815] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.783143] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.783275] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.783341] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.783506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.783588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.783715] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 is going to be created. [ 1418.844964] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.845167] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.845234] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.845492] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.845751] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.865147] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 in Status: IN_PROGRESS for 2s [ 1418.960983] env[65446]: INFO networking_nsxv3.common.synchronization [req-32676166-0755-47e4-91b8-fe480fe082b6 req-1723eaa4-4917-4422-a3a4-e49ee8b48ba9 tempest-ServerActionsTestOtherB-376884766 tempest-ServerActionsTestOtherB-376884766-project-member] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1418.961340] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGHEST for action security_group_members [ 1418.961886] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.961886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.961886] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.962105] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.962198] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.962299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.962358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.962511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.962632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.962702] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.465432] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.465630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.465672] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.466051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.466051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.466282] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.466282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.466282] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.466470] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.466521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.466577] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be updated. [ 1419.493700] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.493967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.493967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.494157] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.494294] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.502858] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: IN_PROGRESS for 2s [ 1420.877701] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 in Status: SUCCESS [ 1420.878087] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.513103] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 in Status: SUCCESS [ 1421.513316] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 deletion is rescheduled due to dependency. [ 1421.513400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.962913] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.963274] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.963550] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.963936] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.964952] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.965345] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.966466] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.966813] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.967653] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.967973] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.968751] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.969213] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.970435] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.970735] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.971422] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.971720] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.196164] env[65446]: INFO networking_nsxv3.common.synchronization [req-2b5e759f-a088-4a8a-a12d-aa833bb8f1eb req-efef6833-2761-4e23-98a4-723e8a72dcb7 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_members [ 1460.196536] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGHEST for action security_group_members [ 1460.197012] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.197012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.197012] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.197768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.197768] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.197768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.197768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.197768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.197768] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.197986] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.700332] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.700567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.700567] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.700750] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.700839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.701035] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.701139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.701187] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.701402] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.701506] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.701596] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 is going to be updated. [ 1460.729722] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.729934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.729934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.730106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.730245] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.737925] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 in Status: IN_PROGRESS for 2s [ 1462.748857] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 in Status: SUCCESS [ 1462.748857] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 deletion is rescheduled due to dependency. [ 1462.748857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.197635] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.198077] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.198973] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.199489] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.544589] env[65446]: INFO networking_nsxv3.common.synchronization [req-5bd9812e-b4b5-411f-ac2e-072de58de9dd req-da524f7c-b96e-46f2-a9dd-421aad4c4136 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_members [ 1471.544589] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGHEST for action security_group_members [ 1471.544589] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.544918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.544918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.544990] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.545099] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.545204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.545265] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.545412] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.545496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.545587] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.048657] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.048950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.048950] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.049125] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.049218] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.049458] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.049564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.049623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.049779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.049856] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.049943] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a is going to be updated. [ 1472.081020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.081271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.081271] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.081440] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.081583] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.090277] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a in Status: IN_PROGRESS for 2s [ 1474.102703] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a in Status: SUCCESS [ 1474.103278] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a deletion is rescheduled due to dependency. [ 1474.103278] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.268419] env[65446]: INFO networking_nsxv3.common.synchronization [None req-34b71a46-361d-47f9-b334-202af8eef8dd tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_rules [ 1476.268821] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_rules [ 1476.269012] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.269146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.269216] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.269474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.269563] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.366829] env[65446]: INFO networking_nsxv3.common.synchronization [None req-c4169f34-5626-4cf6-844e-e6da1931f950 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_rules [ 1476.367152] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_rules [ 1476.367458] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.367574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.794564] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.794564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.794564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.794564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.794937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.794937] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a already deleted. [ 1476.794937] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.795170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.795170] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.795296] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.319913] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.320325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.320325] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.320427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.320462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.320652] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a already deleted. [ 1477.320708] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.368596] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.368990] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.765023] env[65446]: INFO networking_nsxv3.common.synchronization [req-955439d6-9af9-40b9-986a-76c19e321bbd req-af55adc0-7ef6-45c3-972f-d920f6bd3911 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_members [ 1481.765296] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_members [ 1481.765616] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.765737] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.765806] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.766135] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.766298] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.766399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.766465] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.766608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.766696] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.766779] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.023900] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.024116] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.024265] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.024551] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.024807] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.024978] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.025107] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.025331] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.025477] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.025725] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1482.025844] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1482.025967] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1482.026091] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1482.026410] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1482.026410] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1482.026535] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1482.053818] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1482.054032] env[65446]: DEBUG dogpile.cache.region [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1482.054136] env[65446]: DEBUG dogpile.lock [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1482.054357] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.054676] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock port-2f062a2e-ad4c-4191-80ec-d4da3d8af568 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.054854] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.054974] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.055321] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.055461] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f062a2e-ad4c-4191-80ec-d4da3d8af568',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.268568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.268801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.268801] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.268966] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.269068] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.269269] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.269373] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.269437] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.269588] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.269664] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.269750] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a already deleted. [ 1482.269906] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.558150] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.558537] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.558537] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.559349] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.559349] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.559349] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Segment Port 2f062a2e-ad4c-4191-80ec-d4da3d8af568 not found, creating... [ 1482.559349] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.559636] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.559636] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.559812] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.559948] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.560251] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.560412] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.560530] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.560763] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.560904] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.561059] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Resource: SegmentPort with ID: 2f062a2e-ad4c-4191-80ec-d4da3d8af568 is going to be created. [ 1482.582792] env[65446]: DEBUG networking_nsxv3.common.locking [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.583014] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.583148] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.583479] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.583712] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.583956] env[65446]: DEBUG oslo_concurrency.lockutils [None req-872bacd6-b850-4085-ae28-8b6d9cb8a1a8 None None] Releasing lock "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.266989] env[65446]: INFO networking_nsxv3.common.synchronization [req-955439d6-9af9-40b9-986a-76c19e321bbd req-cf645c85-db60-4972-bf00-6695c1c26f65 service nova] Enqueued Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_rules [ 1483.267199] env[65446]: INFO networking_nsxv3.common.synchronization [req-955439d6-9af9-40b9-986a-76c19e321bbd req-cf645c85-db60-4972-bf00-6695c1c26f65 service nova] Enqueued Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_members [ 1483.267341] env[65446]: INFO networking_nsxv3.common.synchronization [req-955439d6-9af9-40b9-986a-76c19e321bbd req-cf645c85-db60-4972-bf00-6695c1c26f65 service nova] Enqueued Resource ID: 2f062a2e-ad4c-4191-80ec-d4da3d8af568 with Priority: HIGHEST for action port [ 1483.267862] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_rules [ 1483.268000] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_members [ 1483.268189] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f062a2e-ad4c-4191-80ec-d4da3d8af568 with Priority: HIGHEST for action port [ 1483.268475] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.268604] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.268673] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.268875] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.268959] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.270262] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.270262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.270262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.270262] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.270497] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.270497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.270497] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.270637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.270637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.270709] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.271438] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f062a2e-ad4c-4191-80ec-d4da3d8af568 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.271652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.271652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.271944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.271944] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f062a2e-ad4c-4191-80ec-d4da3d8af568',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.773567] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.773918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.773918] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.774850] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f062a2e-ad4c-4191-80ec-d4da3d8af568 with status ACTIVE [ 1483.775049] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.775168] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.775235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.775448] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.775527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.775705] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.775800] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.775861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.776015] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.776137] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.776273] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.776364] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.776423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.776562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.776634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.776714] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f062a2e-ad4c-4191-80ec-d4da3d8af568 is going to be updated. [ 1483.801295] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.801527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.801527] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.801719] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.801855] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.802025] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f062a2e-ad4c-4191-80ec-d4da3d8af568" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.278816] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.782042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.782042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.782042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.782042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.782042] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.782042] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a is going to be created. [ 1484.811264] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.811485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.811485] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.811805] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.811890] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.823391] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a in Status: UNINITIALIZED for 2s [ 1486.835735] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a in Status: SUCCESS [ 1486.836146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.836146] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.836303] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.836501] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.836623] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.836689] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.836841] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.836919] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.837014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.837109] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.339830] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.842690] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a: rpc.has_security_group_logging(os_id): False [ 1487.861452] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.861654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.861654] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.861877] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.861967] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.862233] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.862338] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.862400] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.862546] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.862624] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.862709] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a is going to be created. [ 1487.929118] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.929339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.929339] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.929541] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.929721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.940656] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a in Status: IN_PROGRESS for 2s [ 1488.269754] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.269931] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1489.959825] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a in Status: SUCCESS [ 1489.959825] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.270579] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.270579] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.565272] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1495.565760] env[65446]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a57b5211-6f2b-45d2-b90a-fc90384e7a13 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1498.271412] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.271791] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.272416] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.272845] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1508.273625] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1508.274083] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1513.274958] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1513.274958] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1518.275940] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1518.276386] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.277461] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.277461] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.278506] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.278930] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.279702] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.280162] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1538.281037] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1538.281037] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.282147] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.282523] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.518540] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.518905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.518905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.519051] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.519173] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.716479] env[65446]: INFO networking_nsxv3.common.synchronization [req-d1c8e266-e66d-4b2c-9c9e-23d67c6ab736 req-15f703be-bc40-4810-b7ec-1ca90f379a60 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_members [ 1546.717127] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGHEST for action security_group_members [ 1546.717526] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.717871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.717871] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.718160] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.718457] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.718643] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.718767] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.718956] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.719056] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.719177] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.021381] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.221927] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.222184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.222184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.222406] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.222496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.222689] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.222787] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.222851] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.222994] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.223082] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.223168] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a is going to be updated. [ 1547.267837] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.268059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.268059] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.268263] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.268401] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.276918] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a in Status: IN_PROGRESS for 2s [ 1547.524014] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.026962] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1548.027222] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1548.827685] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.828134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.828134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.828134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.983988] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1548.984839] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.985985] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1549.028423] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.028655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.028655] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.028847] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.042521] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.043351] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1549.043430] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.043523] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1549.071938] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.072166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.072166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.072421] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.073174] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.073338] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1549.144118] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.144397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.144397] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.144556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.144918] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.145216] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1549.304987] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a in Status: IN_PROGRESS for 4s [ 1549.314689] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.314917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.314917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.315147] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.315451] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.315709] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:23. [ 1549.315796] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0cb0c2db-4ab0-4029-81e5-acf688b8013a', '402cce96-6e31-494c-bb81-68025c181757', '98940883-9fda-4b23-9149-fb7213985597', '1e2bc70b-412d-4280-9fad-bebbfedfd5fe', '3cf2acbb-4fc0-49a3-8144-c12b91e2c26a', '4bcaa519-eaf6-4bf5-a9ec-8f1e80048184', '1358f1df-64ea-4b5e-909f-92bef5099bf1', '8b57e5c1-c933-4317-815e-0311cc4e843e', '56ef744e-edae-484b-8821-4f332fd192db', 'a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8', 'ea407653-fe6d-49fc-ae9f-5964f5403512', 'e23716b6-1df0-449b-b54b-5cbfb06165bd', '545f9fb3-ef14-4e31-a99e-b6b0b153644f', '992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c', '3e72bae3-70cb-43fb-a5f0-90cde0349d10', '7232f86f-8f31-43de-aad8-e42a48d1755e', 'ef2378e4-6034-4c52-b983-3b0244de565d', '722b2657-3054-4f94-8e4a-ff7958eed1a2', 'c643e66c-7f7f-4e0f-8505-d639c9542f3e', '79c30290-ba80-4936-8673-39beeb72a136', '4c822184-f94c-47e7-a37a-4a1a1df93e39', '73f89999-ebe2-4491-b7a9-a88502cfe139', 'a52dc89f-2bc0-4c67-9305-7b4a7ac9ad44'} {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.315884] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1549.333081] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.333292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.333292] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.333487] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.333570] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.333680] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1549.333749] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.333858] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1549.416551] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.416772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.416772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.416943] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.418101] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.418369] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1549.418446] env[65446]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65446) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.418519] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1549.418585] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1549.418668] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/23 resources of Type:Security Group Rules [ 1549.418741] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGH for action security_group_rules [ 1549.418820] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGH for action security_group_rules [ 1549.418887] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGH for action security_group_rules [ 1549.418959] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGH for action security_group_rules [ 1549.419014] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGH for action security_group_rules [ 1549.419079] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGH for action security_group_rules [ 1549.419140] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGH for action security_group_rules [ 1549.419201] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGH for action security_group_rules [ 1549.419260] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGH for action security_group_rules [ 1549.419321] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGH for action security_group_rules [ 1549.419380] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGH for action security_group_rules [ 1549.419439] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGH for action security_group_rules [ 1549.419499] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGH for action security_group_rules [ 1549.419559] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGH for action security_group_rules [ 1549.419619] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGH for action security_group_rules [ 1549.419680] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGH for action security_group_rules [ 1549.419740] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGH for action security_group_rules [ 1549.419802] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGH for action security_group_rules [ 1549.419857] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGH for action security_group_rules [ 1549.419922] env[65446]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGH for action security_group_rules [ 1549.420053] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.314343] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a in Status: SUCCESS [ 1551.314702] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a deletion is rescheduled due to dependency. [ 1551.314702] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.457715] env[65446]: INFO networking_nsxv3.common.synchronization [None req-fa70146e-c95e-49ad-bde2-68546747c178 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_rules [ 1551.458123] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_rules [ 1551.458274] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a with Priority: HIGH for action security_group_rules [ 1551.458377] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98940883-9fda-4b23-9149-fb7213985597 with Priority: HIGH for action security_group_rules [ 1551.458475] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 with Priority: HIGH for action security_group_rules [ 1551.458571] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 with Priority: HIGH for action security_group_rules [ 1551.458666] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79c30290-ba80-4936-8673-39beeb72a136 with Priority: HIGH for action security_group_rules [ 1551.458758] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e with Priority: HIGH for action security_group_rules [ 1551.458847] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 with Priority: HIGH for action security_group_rules [ 1551.458938] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2378e4-6034-4c52-b983-3b0244de565d with Priority: HIGH for action security_group_rules [ 1551.459047] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c with Priority: HIGH for action security_group_rules [ 1551.459146] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232f86f-8f31-43de-aad8-e42a48d1755e with Priority: HIGH for action security_group_rules [ 1551.459236] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f with Priority: HIGH for action security_group_rules [ 1551.459324] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23716b6-1df0-449b-b54b-5cbfb06165bd with Priority: HIGH for action security_group_rules [ 1551.459411] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea407653-fe6d-49fc-ae9f-5964f5403512 with Priority: HIGH for action security_group_rules [ 1551.459834] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 with Priority: HIGH for action security_group_rules [ 1551.460033] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ef744e-edae-484b-8821-4f332fd192db with Priority: HIGH for action security_group_rules [ 1551.460156] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 with Priority: HIGH for action security_group_rules [ 1551.460259] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b57e5c1-c933-4317-815e-0311cc4e843e with Priority: HIGH for action security_group_rules [ 1551.460354] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a with Priority: HIGH for action security_group_rules [ 1551.460444] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402cce96-6e31-494c-bb81-68025c181757 with Priority: HIGH for action security_group_rules [ 1551.460534] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe with Priority: HIGH for action security_group_rules [ 1551.460847] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17112af0-67b2-45d1-9dd3-cc448867accd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.460981] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.461061] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.461332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.461406] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.462347] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.462459] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.462513] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.462683] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.462762] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cb0c2db-4ab0-4029-81e5-acf688b8013a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.463563] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98940883-9fda-4b23-9149-fb7213985597 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.463670] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.463734] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.463923] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.463997] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98940883-9fda-4b23-9149-fb7213985597',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.464945] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1358f1df-64ea-4b5e-909f-92bef5099bf1 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.464945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.464945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.465095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.465095] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1358f1df-64ea-4b5e-909f-92bef5099bf1',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.465960] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.466089] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.466197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.466299] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.466404] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e72bae3-70cb-43fb-a5f0-90cde0349d10',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.467356] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79c30290-ba80-4936-8673-39beeb72a136 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.467463] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.467531] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.467681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.467753] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79c30290-ba80-4936-8673-39beeb72a136',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.468430] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.468556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.468600] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.468740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.468812] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c643e66c-7f7f-4e0f-8505-d639c9542f3e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.469505] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-722b2657-3054-4f94-8e4a-ff7958eed1a2 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.469627] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.469676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.469799] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.469867] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('722b2657-3054-4f94-8e4a-ff7958eed1a2',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.470640] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef2378e4-6034-4c52-b983-3b0244de565d taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.470752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.470798] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.470951] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.471130] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef2378e4-6034-4c52-b983-3b0244de565d',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.471676] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.471976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.471976] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.472104] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.472104] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.472755] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7232f86f-8f31-43de-aad8-e42a48d1755e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.472857] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.472917] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.473284] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.473284] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7232f86f-8f31-43de-aad8-e42a48d1755e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.473903] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.474084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.474084] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.474235] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.474279] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('545f9fb3-ef14-4e31-a99e-b6b0b153644f',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.475086] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e23716b6-1df0-449b-b54b-5cbfb06165bd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.475086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.475709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.475709] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.475709] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e23716b6-1df0-449b-b54b-5cbfb06165bd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.476039] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea407653-fe6d-49fc-ae9f-5964f5403512 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.476166] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.476542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.476542] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.476542] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea407653-fe6d-49fc-ae9f-5964f5403512',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.477354] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.477354] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.477804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.477804] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.477804] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.478700] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56ef744e-edae-484b-8821-4f332fd192db taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.478846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.478846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.478947] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.479030] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56ef744e-edae-484b-8821-4f332fd192db',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.479746] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.479975] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.480096] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.480601] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.480601] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcaa519-eaf6-4bf5-a9ec-8f1e80048184',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.481110] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b57e5c1-c933-4317-815e-0311cc4e843e taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.481204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.481867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.481867] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.481867] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b57e5c1-c933-4317-815e-0311cc4e843e',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.482968] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.484029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.484029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.484029] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.484029] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cf2acbb-4fc0-49a3-8144-c12b91e2c26a',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.484986] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402cce96-6e31-494c-bb81-68025c181757 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.485346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.485432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.485630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.485703] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402cce96-6e31-494c-bb81-68025c181757',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.488032] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.488139] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.488224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.488386] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.488458] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e2bc70b-412d-4280-9fad-bebbfedfd5fe',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.521446] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.521599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.521653] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.521860] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.524390] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.524514] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.525639] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.525740] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.537451] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.537659] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.539668] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.539765] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.540500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.540613] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 722b2657-3054-4f94-8e4a-ff7958eed1a2 is going to be deleted. [ 1551.541499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.541656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.553134] env[65446]: INFO networking_nsxv3.common.synchronization [None req-63e8c5e4-7495-4be2-abf6-351da1833ff9 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_rules [ 1551.553647] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_rules [ 1551.553929] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17112af0-67b2-45d1-9dd3-cc448867accd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.554081] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.559634] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.559750] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cb0c2db-4ab0-4029-81e5-acf688b8013a is going to be deleted. [ 1551.560608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.560812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.560903] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.561010] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17112af0-67b2-45d1-9dd3-cc448867accd already deleted. [ 1551.561099] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.561500] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.561668] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.562495] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.562661] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.562748] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.581499] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.581625] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1358f1df-64ea-4b5e-909f-92bef5099bf1 is going to be deleted. [ 1551.582511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.582716] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.609226] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.609352] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79c30290-ba80-4936-8673-39beeb72a136 is going to be deleted. [ 1551.643111] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.643329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.643329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.643474] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.643562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.643701] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-722b2657-3054-4f94-8e4a-ff7958eed1a2" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.644742] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.644894] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.644944] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.645143] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.645230] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.645347] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1358f1df-64ea-4b5e-909f-92bef5099bf1" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.661123] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.661358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.661358] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.661564] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.661652] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.661846] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cb0c2db-4ab0-4029-81e5-acf688b8013a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.670948] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.671145] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.671197] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.671407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.671496] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.671612] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79c30290-ba80-4936-8673-39beeb72a136" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.017068] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.017256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.017329] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.017528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.020745] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.020909] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.023020] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.023136] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.031906] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.032062] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.044733] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.044905] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.046212] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.046407] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.047355] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.047524] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7232f86f-8f31-43de-aad8-e42a48d1755e is going to be deleted. [ 1552.048572] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.048812] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.053371] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.053551] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.058757] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.058865] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.061617] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.061712] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.062912] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.063035] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.063744] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.063845] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.064586] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.064695] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.066258] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.066356] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.066931] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1552.067349] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.067444] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.068553] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1552.068996] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.069106] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.069719] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1552.070222] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.070314] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.089104] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1552.089676] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.089862] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402cce96-6e31-494c-bb81-68025c181757 is going to be deleted. [ 1552.091180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.091480] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.109974] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.110151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.118511] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.118650] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e72bae3-70cb-43fb-a5f0-90cde0349d10 is going to be deleted. [ 1552.119632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.119859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.139317] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.139487] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cf2acbb-4fc0-49a3-8144-c12b91e2c26a is going to be deleted. [ 1552.140434] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.140650] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.149601] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.149790] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.158750] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.158927] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.160733] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.160860] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8 is going to be deleted. [ 1552.161741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.161962] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.198232] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.198404] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.224599] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.224738] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef2378e4-6034-4c52-b983-3b0244de565d is going to be deleted. [ 1552.225710] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.225932] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.244094] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.244298] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.279497] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.279752] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.299212] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1552.299669] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.299818] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56ef744e-edae-484b-8821-4f332fd192db is going to be deleted. [ 1552.300824] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.301075] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.355596] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.355987] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea407653-fe6d-49fc-ae9f-5964f5403512 is going to be deleted. [ 1552.356899] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.357193] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.358839] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.358987] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.422151] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.422498] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c643e66c-7f7f-4e0f-8505-d639c9542f3e is going to be deleted. [ 1552.423256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.423482] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.472565] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.472802] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e2bc70b-412d-4280-9fad-bebbfedfd5fe is going to be deleted. [ 1552.474072] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.474309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.483791] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.484047] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.494282] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.494479] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.521668] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.521819] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.526224] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.526380] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 545f9fb3-ef14-4e31-a99e-b6b0b153644f is going to be deleted. [ 1552.527309] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.527528] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.584529] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.584741] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.597574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.597726] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98940883-9fda-4b23-9149-fb7213985597 is going to be deleted. [ 1552.598706] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.598928] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.658685] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.658888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.700861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.701062] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c is going to be deleted. [ 1552.702471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.702793] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.756148] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.756343] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcaa519-eaf6-4bf5-a9ec-8f1e80048184 is going to be deleted. [ 1552.757350] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.757580] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.759722] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.759859] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.802947] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.803180] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.814539] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.814741] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e23716b6-1df0-449b-b54b-5cbfb06165bd is going to be deleted. [ 1552.815707] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.815949] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.871779] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.871968] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b57e5c1-c933-4317-815e-0311cc4e843e is going to be deleted. [ 1552.872852] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.873095] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.873185] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.873283] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17112af0-67b2-45d1-9dd3-cc448867accd already deleted. [ 1552.873368] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.873526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.873684] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.873763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.873914] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7232f86f-8f31-43de-aad8-e42a48d1755e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.874556] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.874723] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.874809] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.874948] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402cce96-6e31-494c-bb81-68025c181757" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.875083] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.875233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.875313] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.875426] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e72bae3-70cb-43fb-a5f0-90cde0349d10" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.875550] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.875688] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.875763] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.875876] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cf2acbb-4fc0-49a3-8144-c12b91e2c26a" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.875997] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.876171] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.876250] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.876387] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5772d2e-ee46-4fb6-a4ca-40f732b8f5c8" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.876455] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.876589] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.876663] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.876762] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef2378e4-6034-4c52-b983-3b0244de565d" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.876883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.877033] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.877109] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.877221] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56ef744e-edae-484b-8821-4f332fd192db" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.877351] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.877488] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.877562] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.877671] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea407653-fe6d-49fc-ae9f-5964f5403512" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.877796] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.877986] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.878086] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.878198] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c643e66c-7f7f-4e0f-8505-d639c9542f3e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.878371] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.878533] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.878608] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.878721] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e2bc70b-412d-4280-9fad-bebbfedfd5fe" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.878848] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.878984] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.879069] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.879176] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-545f9fb3-ef14-4e31-a99e-b6b0b153644f" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.879300] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.879432] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.879503] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.879610] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98940883-9fda-4b23-9149-fb7213985597" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.879729] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.879861] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.879934] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.880054] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992e4a9f-ed25-4d1b-8ce7-9efa6f0e218c" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.937762] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.937977] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.938046] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.938256] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.938359] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.938471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcaa519-eaf6-4bf5-a9ec-8f1e80048184" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.961169] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.961346] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.961393] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.961592] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.961680] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.961826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e23716b6-1df0-449b-b54b-5cbfb06165bd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.997932] env[65446]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1552.998562] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.998700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.998772] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.999041] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.999133] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.999289] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b57e5c1-c933-4317-815e-0311cc4e843e" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.554641] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.555166] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.002179] env[65446]: INFO networking_nsxv3.common.synchronization [req-7fdcf602-4734-4543-898d-282b336641d8 req-3abd99fd-ce91-40e1-99a0-16eb88f15b19 tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_members [ 1557.002727] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_members [ 1557.003028] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-17112af0-67b2-45d1-9dd3-cc448867accd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.003158] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.003223] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.003471] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.003627] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.003724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.003785] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.004399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.004399] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.004472] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.302951] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.303165] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.303320] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.303596] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.303853] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.304053] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.304173] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.304386] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.304520] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.304760] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1557.304893] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] NeedRegenerationException {{(pid=65446) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1557.305025] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] no value, waiting for create lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1557.305133] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] value creation lock acquired {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1557.305243] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] No value present for key: 'zone-id' {{(pid=65446) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1557.305345] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Calling creation function for not-yet-present value {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1557.305472] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1557.325428] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1557.325623] env[65446]: DEBUG dogpile.cache.region [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65446) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1557.325729] env[65446]: DEBUG dogpile.lock [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Released creation lock {{(pid=65446) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1557.325908] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "network-7" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.326258] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 taken with stack trace [, , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.326456] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.326579] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.326901] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.327055] env[65446]: DEBUG networking_nsxv3.api.rpc [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.506847] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.507074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.507074] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.507297] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.507385] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.507578] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.507700] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.507775] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.507926] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.508014] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.508110] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17112af0-67b2-45d1-9dd3-cc448867accd already deleted. [ 1557.508192] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.829791] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.830111] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.830159] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.830434] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.830580] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.830734] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Segment Port e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 not found, creating... [ 1557.830998] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.831181] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.831321] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.831512] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.831660] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.832091] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.832278] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.832398] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.832610] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.832747] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.832891] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Resource: SegmentPort with ID: e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 is going to be created. [ 1557.859377] env[65446]: DEBUG networking_nsxv3.common.locking [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.859592] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.859698] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.859964] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.860216] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.860449] env[65446]: DEBUG oslo_concurrency.lockutils [None req-c751f3e8-cbd2-4608-b4e2-c5d2df8123bd None None] Releasing lock "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.399418] env[65446]: INFO networking_nsxv3.common.synchronization [req-7fdcf602-4734-4543-898d-282b336641d8 req-f3183d66-cf36-4a2d-a7b9-0a26096424c7 service nova] Enqueued Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_rules [ 1559.399689] env[65446]: INFO networking_nsxv3.common.synchronization [req-7fdcf602-4734-4543-898d-282b336641d8 req-f3183d66-cf36-4a2d-a7b9-0a26096424c7 service nova] Enqueued Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_members [ 1559.399737] env[65446]: INFO networking_nsxv3.common.synchronization [req-7fdcf602-4734-4543-898d-282b336641d8 req-f3183d66-cf36-4a2d-a7b9-0a26096424c7 service nova] Enqueued Resource ID: e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 with Priority: HIGHEST for action port [ 1559.399953] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_rules [ 1559.400094] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_members [ 1559.400191] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 with Priority: HIGHEST for action port [ 1559.400721] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17112af0-67b2-45d1-9dd3-cc448867accd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.400881] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.400924] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.401116] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.401185] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.401996] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-17112af0-67b2-45d1-9dd3-cc448867accd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.402118] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.402184] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.402344] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.402492] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.402586] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.402648] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.402794] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.402879] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.402967] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.403695] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.403808] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.403888] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.404945] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.405091] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.907328] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-17112af0-67b2-45d1-9dd3-cc448867accd taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.907595] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.907656] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.908602] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 with status ACTIVE [ 1559.909266] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.909266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.909266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.909266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.909266] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.909568] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.909568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.909568] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.909681] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.909748] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.909929] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.910032] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.910094] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.910233] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.910306] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.910388] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99 is going to be updated. [ 1559.931042] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.931258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.931258] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.931423] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.931555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.931703] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e62dc66e-d8d1-4cb7-8304-ffc10ebf7d99" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.412152] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.914877] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.915204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.915204] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.915388] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.915619] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.915778] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17112af0-67b2-45d1-9dd3-cc448867accd is going to be created. [ 1560.939718] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.939938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.939938] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.940134] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.940332] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.949027] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17112af0-67b2-45d1-9dd3-cc448867accd in Status: UNINITIALIZED for 2s [ 1562.960883] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17112af0-67b2-45d1-9dd3-cc448867accd in Status: SUCCESS [ 1562.960883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.960883] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.961337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.961337] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.961337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.961337] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.961517] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.961555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.961632] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.961721] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.464166] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.966865] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17112af0-67b2-45d1-9dd3-cc448867accd: rpc.has_security_group_logging(os_id): False [ 1563.985547] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.985769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.985769] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.985969] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.986186] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.986346] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.986464] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.986526] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.986690] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.986770] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.986877] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17112af0-67b2-45d1-9dd3-cc448867accd is going to be created. [ 1564.048243] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.048574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.048574] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.048753] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.048985] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.063596] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17112af0-67b2-45d1-9dd3-cc448867accd in Status: IN_PROGRESS for 2s [ 1564.401677] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.401822] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1566.077060] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17112af0-67b2-45d1-9dd3-cc448867accd in Status: SUCCESS [ 1566.077427] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.670538] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.670538] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1574.670428] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.670883] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.672404] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.672830] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.674052] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.674618] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1589.675936] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1589.676358] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1594.677830] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.678175] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1599.678955] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.679455] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1604.680616] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.680990] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1609.682139] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1609.682548] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1614.683357] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1614.683669] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.684718] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.685206] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.401154] env[65446]: INFO networking_nsxv3.common.synchronization [req-702b3b0f-42a1-4c34-84b4-e6dcd22dc096 req-55a78c00-e168-47e1-afb2-3afca545348a tempest-AttachVolumeNegativeTest-1726542797 tempest-AttachVolumeNegativeTest-1726542797-project-member] Enqueued Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_members [ 1621.401473] env[65446]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17112af0-67b2-45d1-9dd3-cc448867accd with Priority: HIGHEST for action security_group_members [ 1621.402078] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock member-17112af0-67b2-45d1-9dd3-cc448867accd taken with stack trace [, , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.402078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.402078] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.402304] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.402378] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.402555] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.402637] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.402754] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.402826] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.402882] env[65446]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17112af0-67b2-45d1-9dd3-cc448867accd',) {} {{(pid=65446) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1621.905218] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.905462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.905462] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.905630] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.905724] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.905924] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.906028] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.906091] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.906237] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.906312] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.906395] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17112af0-67b2-45d1-9dd3-cc448867accd is going to be updated. [ 1621.940160] env[65446]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65446) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.940363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.940363] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.940512] env[65446]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.940656] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.948417] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17112af0-67b2-45d1-9dd3-cc448867accd in Status: IN_PROGRESS for 2s [ 1623.960097] env[65446]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17112af0-67b2-45d1-9dd3-cc448867accd in Status: SUCCESS [ 1623.960493] env[65446]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17112af0-67b2-45d1-9dd3-cc448867accd deletion is rescheduled due to dependency. [ 1623.960493] env[65446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17112af0-67b2-45d1-9dd3-cc448867accd" {{(pid=65446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.402581] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.403076] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1631.403442] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1631.403907] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1636.404300] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1636.404740] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1641.405877] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1641.406281] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1646.406668] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1646.407133] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1651.407809] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1651.407809] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1656.408800] env[65446]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1656.409236] env[65446]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0